-- Logs begin at Mon 2022-05-23 14:38:19 UTC, end at Mon 2022-05-23 16:35:47 UTC. -- May 23 15:21:33.172578 dv-cinder-835881-14-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 23 15:21:33.179989 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:21:33 2022] *** May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: nodename: dv-cinder-835881-14-iscsi May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: machine: x86_64 May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: clock source: unix May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: pcre jit disabled May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: detected number of CPU cores: 4 May 23 15:21:33.182010 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: current working directory: / May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: detected binary path: /usr/bin/uwsgi-core May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: your processes number limit is 47680 May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: your memory page size is 4096 bytes May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: detected max file descriptor number: 2048 May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: lock engine: pthread robust mutexes May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: thunder lock: enabled May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 15:21:33.182610 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:21:33.229338 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: Python main interpreter initialized at 0x55aa684f69c0 May 23 15:21:33.229338 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: python threads support enabled May 23 15:21:33.229338 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: your server socket listen backlog is limited to 100 connections May 23 15:21:33.229338 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: your mercy for graceful operations on workers is 90 seconds May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: *** Operational MODE: preforking *** May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: *** uWSGI is running in multiple interpreter mode *** May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: spawned uWSGI master process (pid: 80546) May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: spawned uWSGI worker 1 (pid: 80555, cores: 1) May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: spawned uWSGI worker 2 (pid: 80556, cores: 1) May 23 15:21:33.234915 dv-cinder-835881-14-iscsi devstack@keystone.service[80546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:21:33.230277 dv-cinder-835881-14-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 23 15:21:38.896196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:21:38.896196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: from cryptography.utils import int_from_bytes May 23 15:21:38.897002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:21:38.897002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: from cryptography.utils import int_from_bytes May 23 15:21:38.929164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:21:38.929164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: from cryptography.utils import int_from_bytes May 23 15:21:38.929696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:21:38.929696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: from cryptography.utils import int_from_bytes May 23 15:21:38.945421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:21:38.945612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:21:38.945802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] command line args: [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:21:38.946070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:21:38.946246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ================================================================================ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:21:38.946499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] admin_token = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.946743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config_dir = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.946927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.947132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] config_source = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.947309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] debug = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.947504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.947997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.948091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.948283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.949047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.949274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.949453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_config_append = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.949631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.949836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_dir = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.949968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.950199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.950442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.950685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.950929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.951120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.951308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.951550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.951794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.952027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.952258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.952488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.952717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.952961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.953204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.953474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.953959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.954141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] publish_errors = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.954374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.954605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.954783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.955027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.955289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.955525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] standard_threads = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.955755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.955997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.956172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.956345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_journal = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.956518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_json = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.956691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_stderr = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.956863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] use_syslog = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.957093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.957349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.957586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.957842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.958080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.958317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.958556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.958802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.959037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.959307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.959552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.959798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.960051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.960279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.960514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.960757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.961001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.961234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.961485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.961735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.961978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.962212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.962461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.962719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.962969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.963237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.963469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.963698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.963926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.964716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.964966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.965217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.965447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.965676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.965919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.966163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.966399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.966643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.966873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.967117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.967358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.967589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.967817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.968047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.968274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.968509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.968753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.968981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.969214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.969441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.969676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.969911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.970154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.970383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.970618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.970853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.971086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.971344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.971577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.971804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.972048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.972283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.972517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.972747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.973003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.973493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.973721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.973954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.974187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.974453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.974689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.974936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.975278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.975517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.975752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.975988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.976234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.976470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.976706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.976947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.977030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:21:38.977166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:21:38.977255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.977362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] command line args: [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:21:38.977445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.977625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.977702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:21:38.977802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ================================================================================ {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:21:38.977890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.978068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] admin_token = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.978147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.978314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] config_dir = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.978391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.978502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.978590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.978668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] config_source = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.978777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.978855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] debug = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.979012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.979119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.979276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.979356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.979463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.979549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.979743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.979834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.979976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.980053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.980205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.980284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.980403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_config_append = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.980509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.980608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.980709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.980806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_dir = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.980900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_file = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.981005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.981111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.981213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.981342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.981472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.981550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.981631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.981767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.981846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.981964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.982040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.982162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.982247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.982362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.982482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.982608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.982720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.982844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.982945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.external = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.983077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.983202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.983338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.983474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.983576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.983705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.983825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.983935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.password = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.984075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.984194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] auth.token = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.984346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.984426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.984612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.984839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.984917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.985020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] publish_errors = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.985107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.985252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.985335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.985482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.985556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.985661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.985746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.985906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.985984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.986139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.986222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.986374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] standard_threads = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.986462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.986609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.986686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.986851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.986938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.987015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.987118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.987218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] use_journal = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.987357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.987442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] use_json = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.987558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] use_stderr = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.987635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.987780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] use_syslog = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.987861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.987954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:21:38.988097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.988937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.989948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.990853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.991994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.992945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.993977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.994915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.995877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.996844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.997943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.998962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:38.999916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.000858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.001919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.002954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.003905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.004989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.005943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.006955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.007914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.008871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.009954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.010736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.011425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.011518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.011686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.011764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.011919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.012989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.external = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.013901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.password = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] auth.token = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.014892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.015882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.016979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.017942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.018916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.019987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.020920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.021885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.022980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.023947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.024897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.025993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.026071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.026224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.026311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.026467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.026604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.027306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.027400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.027550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.027643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.027798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.027877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.028979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.029921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.030966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.031971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.032859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.033949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.034028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.034182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.034269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.034343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:21:39.034474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.034708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.034958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.035230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.035472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.035709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.035947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.036179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.036419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.036678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.036909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.037156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.037401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.037644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.037880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.038110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.038345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.038582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.038815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.039170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.039428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.039685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.039934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.040183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.040430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.040663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.040911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.041150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.041388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.041625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.041863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.042136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.042397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.042637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.042892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.043144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.043396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.043631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.043871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.044109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.044357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.044610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.044842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.045080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.045324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.045576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.045825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.046063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.046314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.046564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.046802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.047049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.047313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.047554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.047790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] role.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.048037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] role.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.048269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.048519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.048766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.049014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.049262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.049509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.049761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.050007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.050255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.050491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.050739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.050986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.051257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.051507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.051902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.052140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.052389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.052637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.052888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.053139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.053374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.053636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.053890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.054129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.054361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.054592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.054821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.055073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.055352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.055600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.055839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.056077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.056307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.056545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.056782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.057030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.057267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.057524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.057800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.058042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.058288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.058534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.058782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.059016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.059281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.059518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.059772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.060020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.060250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.060496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.060787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.061057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.connection = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.061303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.061548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.061784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.062026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.062263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.062499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.062734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.062969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.063241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.063477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.063729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.063964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.064211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.064445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.064529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.064690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.064771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.064916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.064997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.065155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.065394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:21:39.065564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:21:39.073924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.091314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.091543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.091768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.102038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.102593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.102823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.120420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.120649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.155126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.158430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.205424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.205649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.208404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.208640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.270913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.271996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.272082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.272214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.295420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.295606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.295711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.295792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.295868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.295942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.296797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.308408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.308725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.320713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.320943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.321875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.322004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.322089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.322221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.322438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:21:39.340077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.340284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:21:39.340479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.340620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.340714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:21:39.340825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:21:39.341008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:21:39.341350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.341979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.342231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.353409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.353683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.353949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.354229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.354927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.355232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.355503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.355785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.362329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.363935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.365593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.365868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.366145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.366429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.366709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.366965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.367208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.367296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.367486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.367612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.367763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.367881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.368039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.368153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.368320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.368400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.368690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.368961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.369236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.369510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.369784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.370052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.395212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.396964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.397239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.401288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.402960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.403260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.403536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.403619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.403867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.409254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.409489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.409768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.410776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.411054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.415505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.415908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.416191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.416474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.416748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.417023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.417115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.417852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.417943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.418120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.422301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.422700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.422983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.423292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.423574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.423851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.424122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.424392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.436493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.436765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.441779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.442896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.443197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.445445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.445733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.447814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.450973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.451484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.451780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.454559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.456955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.458369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.458665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.458953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.459255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.459539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.459830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.460568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.464846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.465139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.465426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.465714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.465989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.466278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.479379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.479700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.480458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.480718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.486113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.486391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.486657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.486919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.488681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.490370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.490641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.493675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.493957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.494248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.494514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.494796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.494943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.496680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.496962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.500030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.500314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.500596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.500878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.501221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.508121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.508398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.508675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.508959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.509235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.509505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.509782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.514677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.514959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.515263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.515546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.515826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.516111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.516395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.528206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.531468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.534737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.534927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.536357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.537976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.538196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.538304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.538526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.541497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.543206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.544830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.545115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.545405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.545904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.547529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.550743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.551029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.551331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.551601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.553465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.555054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.558810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.559120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.559404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.559735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.562098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.562378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.562756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.568878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.569164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.569551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.570559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.570838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.571134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.571418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.571687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.571959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.572244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.572507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.572777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.573040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.573304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.573619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.573888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.574142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.577446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:21:39.577728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.578008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.578285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.578558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.578831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.579122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.579483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.579759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.580040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.580324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.580586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.580851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.581118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:21:39.613160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa684f69c0 pid: 80556 (default app) May 23 15:21:39.616362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928ae7-3e0c-4a1a-8920-03d3b173e496 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:39.616652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928ae7-3e0c-4a1a-8920-03d3b173e496 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:39.616928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928ae7-3e0c-4a1a-8920-03d3b173e496 None None] PATH_INFO: `/v3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:39.620938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa684f69c0 pid: 80555 (default app) May 23 15:21:39.621746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Mon May 23 15:21:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:48.436532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:48.437052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:48.437160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:48.441521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:48.446617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:48.446972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:48.447206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:48.514105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: INFO dbcounter [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] Registered counter for database keystone May 23 15:21:48.535295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG oslo_db.sqlalchemy.engines [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80556) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:21:48.541412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writer thread running {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:21:48.714421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG passlib.handlers.bcrypt [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80556) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 15:21:48.714840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG passlib.handlers.bcrypt [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80556) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 15:21:48.770231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:48.771790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:48.898672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 15:21:49.077813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:49.145258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: INFO dbcounter [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] Registered counter for database keystone May 23 15:21:49.164282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:21:49.170409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writer thread running {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:21:49.290098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a889-8e25-4c3e-8646-18e83a340aab None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:49.294896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:49.295593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:49.295881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:49.296161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:49.304246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:49.355949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 15:21:49.356223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016001f-c39b-45b6-9e5f-8808cea30c4f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:49.366069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 23 15:21:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:21:49.372267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:49.386635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322eea4-8e80-4f7c-97c8-31b97d6909b2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:49.391001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:49.392157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:49.392445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:49.392724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] PATH_INFO: `/v3/projects/75147bc201bf4c1086a8eadbdc968fcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:49.394208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] RBAC: Authorizing `identity:get_project(project_id=75147bc201bf4c1086a8eadbdc968fcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:49.553828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING keystone.common.rbac_enforcer.enforcer [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 15:21:49.554461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336af674-ea6a-468d-a7a5-2566c6fdaf47 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:49.558887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Mon May 23 15:21:49 2022] GET /identity/v3/projects/75147bc201bf4c1086a8eadbdc968fcf => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:51.762738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5e120-3b33-43fe-8ec2-89e0e7f154e6 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:51.763284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5e120-3b33-43fe-8ec2-89e0e7f154e6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:51.763369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5e120-3b33-43fe-8ec2-89e0e7f154e6 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:51.767467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:51.772859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:51.773266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:51.773429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:51.792503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:51.794003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:51.801715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 15:21:51.824125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5e120-3b33-43fe-8ec2-89e0e7f154e6 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:51.836030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5e120-3b33-43fe-8ec2-89e0e7f154e6 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:51.840306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813edc7-2e69-4df8-a67f-c5a6f74687af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:51.840936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813edc7-2e69-4df8-a67f-c5a6f74687af admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:51.841221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813edc7-2e69-4df8-a67f-c5a6f74687af admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:51.841499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813edc7-2e69-4df8-a67f-c5a6f74687af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:51.849421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813edc7-2e69-4df8-a67f-c5a6f74687af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:51.851214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813edc7-2e69-4df8-a67f-c5a6f74687af admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:51.860420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 23 15:21:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:21:51.865625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:51.877144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2073e-f9e8-4006-83f5-befe55c9106c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:51.881778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e7fc-ffdd-487f-948e-1bf278981b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:51.882646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e7fc-ffdd-487f-948e-1bf278981b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:51.882926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e7fc-ffdd-487f-948e-1bf278981b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:51.883234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e7fc-ffdd-487f-948e-1bf278981b6e admin admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:51.884637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e7fc-ffdd-487f-948e-1bf278981b6e admin admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:51.886505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e7fc-ffdd-487f-948e-1bf278981b6e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:51.888129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Mon May 23 15:21:51 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:54.146126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6f13-1d06-439d-9652-5806d9503faf None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.146638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6f13-1d06-439d-9652-5806d9503faf None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.146756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6f13-1d06-439d-9652-5806d9503faf None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.148154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:21:54.154086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.154489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.154660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.171170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:54.172366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:54.176984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73608a-68ed-4b74-8851-e8e997beb41c None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.177274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73608a-68ed-4b74-8851-e8e997beb41c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.177555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73608a-68ed-4b74-8851-e8e997beb41c None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.178886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:21:54.183944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.184235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.184514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.224163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG passlib.handlers.bcrypt [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80555) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 15:21:54.224592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG passlib.handlers.bcrypt [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80555) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 15:21:54.253221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:21:54.271044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:54.272662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:54.276995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.309224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:54.372493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:21:54.393924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee32ac-0fae-4fec-bb02-2ab4e56ea29c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:54.394850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.426373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:54.427122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.427415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.427698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.440582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:21:54.452380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:21:54.453238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:21:54.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:21:54.459328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.503959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424bd87-5b86-4b9c-b0c5-814bb7ad0a53 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:54.506946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:54.541634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:54.542726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:54.543668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.543954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.544236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.560119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b5d6-7210-4c59-a6c0-455b6e3a29aa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:54.593788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:54.594459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.594831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.595127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.595886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:21:54.596208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:54.597662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:54.609679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:21:54.613510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:54.615208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.615359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:54.715914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee64fc8-8d0a-44a0-86bf-297f57b33e62 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:54.717317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:21:54.722649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.725638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:54.750096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:54.750966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.751280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.751555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.752810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:54.754279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:54.755913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:21:54.761716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.775900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:54.820228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aad5c-981c-45ba-97c6-97d69086d2db None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:54.853869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:54.854685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.854971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.855280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.861683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80eb82-f53b-489f-8fda-747527097c54 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:54.873358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:54.874830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:54.895372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:21:54.895824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:21:54.905499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:21:54.906463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:21:54.906463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:21:54.906463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:21:54.906463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:21:54.906671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:54.906671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:54.906671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:54.906891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 9/18] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:21:54.906954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:54.906954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:54.906954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 10/19] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:21:54.907167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.907404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:54.962056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:54.994976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:55.015201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c317e-51ac-4388-9ac0-8b71cd6812c2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:55.052250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:55.052932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:55.053226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:55.053508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:55.054395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.domain.id=default, user.id=f9d0e31020494ca584e4bf621abe8d70) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:21:55.054710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:55.056242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5f3b-5c2a-4fdb-b8ab-60665b212139 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:55.064562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/role_assignments?user.id=f9d0e31020494ca584e4bf621abe8d70&scope.domain.id=default&role.id=cc12091eec434ea294a879c1b207931e => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:21:55.121312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f055ce-2761-448d-b2b2-2cc902759b6d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:55.161294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:55.161999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:55.162283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:55.162558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:55.163335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:21:55.163643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:55.165153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca3191-c80b-441b-a7db-aebaa5d8b8ed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:55.185152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:21:57.543872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254d87-4527-4180-a201-e48bd33f36f9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:57.544880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254d87-4527-4180-a201-e48bd33f36f9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:57.545387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254d87-4527-4180-a201-e48bd33f36f9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:57.546944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:57.552597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd74f7-4ed2-4e24-905b-e0aa305360f7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:57.553021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd74f7-4ed2-4e24-905b-e0aa305360f7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:57.553239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd74f7-4ed2-4e24-905b-e0aa305360f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:57.588133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f3bd74f7-4ed2-4e24-905b-e0aa305360f7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:57.589367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f3bd74f7-4ed2-4e24-905b-e0aa305360f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:57.678665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:21:57.723871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254d87-4527-4180-a201-e48bd33f36f9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:57.876274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254d87-4527-4180-a201-e48bd33f36f9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:57.927840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:57.928651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:57.928935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:57.929214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:57.941342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706bdc7-c1fd-49bc-adfa-fc4d0526cff6 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:57.941895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706bdc7-c1fd-49bc-adfa-fc4d0526cff6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:57.942307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706bdc7-c1fd-49bc-adfa-fc4d0526cff6 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:57.944254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:57.948722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:21:57.951503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:57.952382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:57.952813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:21:57.956777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:21:57.957860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:21:57.958795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 13/25] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:21:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:21:57.964646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:57.987437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:57.988042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:57.991603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:58.082397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:58.116340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 13/26] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:21:58.143433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:58.158881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ffb3-5874-4815-831b-ea356b65ac9c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.229008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.230087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.230591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.231061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.232056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:21:58.232565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.234202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a274-0d9d-4d9e-a4b8-9cc49d5487a9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:58.246545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 14/27] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:58.248277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372760d9-db5b-41d3-9c0d-3fa8bf428c0e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.248785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372760d9-db5b-41d3-9c0d-3fa8bf428c0e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.249259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372760d9-db5b-41d3-9c0d-3fa8bf428c0e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.250773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 15/28] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:58.255772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372760d9-db5b-41d3-9c0d-3fa8bf428c0e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:58.325504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a238c95-39e6-4cc7-b452-799608594f36 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.333921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:58.369665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372760d9-db5b-41d3-9c0d-3fa8bf428c0e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.406500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e5c4a-13ea-4c99-91f7-4a3e3246b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.407330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5c4a-13ea-4c99-91f7-4a3e3246b05e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.407617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5c4a-13ea-4c99-91f7-4a3e3246b05e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.407890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5c4a-13ea-4c99-91f7-4a3e3246b05e None admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.409324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e5c4a-13ea-4c99-91f7-4a3e3246b05e None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.410792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e5c4a-13ea-4c99-91f7-4a3e3246b05e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:58.412587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 16/29] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:21:58 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:58.413723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.414080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.414358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.431569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:58.433270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:58.447390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.448222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.448506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.448784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.480726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.482226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:58.506296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 17/30] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:21:58.507218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:21:58.517517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:21:58.518306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:21:58.519118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:21:58.519118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:21:58.519118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:21:58.519118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:21:58.529117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 14/31] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:21:58.530082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:58.613594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:58.636168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:58.672537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97ee3-a82a-4a1b-9647-38af47c648d9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.710714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.711545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.711827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.712104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.713500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.715609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:58.717467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 18/32] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:58.718271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:58.742145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02656a-164f-4673-823e-d50056fd2062 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.780537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.781210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.781494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.781767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.782605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:21:58.782913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.784417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:58.797644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 15/33] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:58.798480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:58.830022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ddc92-a05c-43b2-9493-7651d39800e2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.862348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:58.867527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b418f12-77c7-4f13-96d4-0748f844dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.868282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b418f12-77c7-4f13-96d4-0748f844dccd None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.868661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b418f12-77c7-4f13-96d4-0748f844dccd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.869012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b418f12-77c7-4f13-96d4-0748f844dccd None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.870379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b418f12-77c7-4f13-96d4-0748f844dccd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.871887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b418f12-77c7-4f13-96d4-0748f844dccd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:58.903214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:58.915415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ad49-5100-4c2b-85ba-1903cc4374cd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:58.951162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af588b8b-e952-416d-96d7-a7a07de4b79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:58.952206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af588b8b-e952-416d-96d7-a7a07de4b79f None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:58.952488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af588b8b-e952-416d-96d7-a7a07de4b79f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:58.952778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af588b8b-e952-416d-96d7-a7a07de4b79f None admin] PATH_INFO: `/v3/domains/default/users/f9d0e31020494ca584e4bf621abe8d70/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:58.955168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af588b8b-e952-416d-96d7-a7a07de4b79f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f9d0e31020494ca584e4bf621abe8d70, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:58.956615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af588b8b-e952-416d-96d7-a7a07de4b79f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:59.092360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 19/34] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 23 15:21:58 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:21:59.094498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941a7b-4e5c-4e2c-92cf-5a45390b856e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.095038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941a7b-4e5c-4e2c-92cf-5a45390b856e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.095553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941a7b-4e5c-4e2c-92cf-5a45390b856e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.097172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 20/35] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:59.098258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941a7b-4e5c-4e2c-92cf-5a45390b856e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:59.182885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 16/36] 10.222.0.32 () {58 vars in 1361 bytes} [Mon May 23 15:21:58 2022] PUT /identity/v3/domains/default/users/f9d0e31020494ca584e4bf621abe8d70/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:21:59.185089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1036609-2410-4086-81e3-8b09cd3e9b52 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.185773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1036609-2410-4086-81e3-8b09cd3e9b52 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.186075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1036609-2410-4086-81e3-8b09cd3e9b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.230822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a1036609-2410-4086-81e3-8b09cd3e9b52 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:59.230980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a1036609-2410-4086-81e3-8b09cd3e9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:59.363697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 17/37] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:21:59.371306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bf078-f5a3-4cd0-a6ba-a7ba5231e466 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.371607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bf078-f5a3-4cd0-a6ba-a7ba5231e466 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.371889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bf078-f5a3-4cd0-a6ba-a7ba5231e466 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.377074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 18/38] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:59.378330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941a7b-4e5c-4e2c-92cf-5a45390b856e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:59.383513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.383801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.384089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.421325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:59.422582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:59.436217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e7fa-375b-4eab-9314-f579f1d75de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:59.436906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e7fa-375b-4eab-9314-f579f1d75de7 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.437191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e7fa-375b-4eab-9314-f579f1d75de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.437479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e7fa-375b-4eab-9314-f579f1d75de7 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.438217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e7fa-375b-4eab-9314-f579f1d75de7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:59.440572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e7fa-375b-4eab-9314-f579f1d75de7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:59.503975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 19/39] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:21:59.504743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:59.515857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:59.566604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/projects => generated 301 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:21:59.576605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320cd6-4c5f-4020-8c84-8850ef9916d5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.576971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320cd6-4c5f-4020-8c84-8850ef9916d5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.577271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320cd6-4c5f-4020-8c84-8850ef9916d5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.582920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 22/41] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:21:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:59.582920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320cd6-4c5f-4020-8c84-8850ef9916d5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:59.619113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786edb0e-100b-4c56-ad5e-bf18ad043fb3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:59.656375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:59.680971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:59.682868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.683441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.684114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.686130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:59.687996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:59.719492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320cd6-4c5f-4020-8c84-8850ef9916d5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:59.755851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4186f-4f1d-49f1-b48b-ce12cec8c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:59.756583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4186f-4f1d-49f1-b48b-ce12cec8c221 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.756871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4186f-4f1d-49f1-b48b-ce12cec8c221 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.757151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4186f-4f1d-49f1-b48b-ce12cec8c221 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.758464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4186f-4f1d-49f1-b48b-ce12cec8c221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:59.759982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4186f-4f1d-49f1-b48b-ce12cec8c221 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:59.761771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 23/42] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:21:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:21:59.762891 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.768899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.768899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.775184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 20/43] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/roles => generated 219 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:21:59.776857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:59.784476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:59.786111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:59.870734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:59.885505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 24/44] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:21:59.909926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:59.918237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb0f5-d58a-403a-a4b5-3e3c6b3eed45 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:59.980181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e90b4-ed44-438e-bc61-b19ba5540384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:59.981222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e90b4-ed44-438e-bc61-b19ba5540384 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:59.981708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e90b4-ed44-438e-bc61-b19ba5540384 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:59.982187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e90b4-ed44-438e-bc61-b19ba5540384 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:59.983741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e90b4-ed44-438e-bc61-b19ba5540384 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:59.986002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e90b4-ed44-438e-bc61-b19ba5540384 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:59.987006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:00.053585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb268c-eb62-4b89-94b3-e030f31e071b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:00.088230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385aa4e-2f7b-4197-a508-07989c9b77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:00.088960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385aa4e-2f7b-4197-a508-07989c9b77ee None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:00.089251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385aa4e-2f7b-4197-a508-07989c9b77ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:00.089537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385aa4e-2f7b-4197-a508-07989c9b77ee None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:00.090300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385aa4e-2f7b-4197-a508-07989c9b77ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:00.091722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385aa4e-2f7b-4197-a508-07989c9b77ee None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:00.103198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 21/45] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/projects => generated 312 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:00.183130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 25/46] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 23 15:21:59 2022] POST /identity/v3/roles => generated 223 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:22:01.555862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba4ba-58d9-40e7-8339-5a2fa97c1721 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:01.556348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba4ba-58d9-40e7-8339-5a2fa97c1721 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:01.556348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ba4ba-58d9-40e7-8339-5a2fa97c1721 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:01.557707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 22/47] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:01.562901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:01.563329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:01.563620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:01.580479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:01.581657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:01.647703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 26/48] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:01.671520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba4ba-58d9-40e7-8339-5a2fa97c1721 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:01.771720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ba4ba-58d9-40e7-8339-5a2fa97c1721 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:01.791370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:01.804654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:01.805445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:01.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:01.806143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:01.817481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:01.826795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:01.827795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:01.828613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 23/49] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:01.833895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:01.863935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:01.931152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1ced4-1e5c-44f9-a534-d3b2fe486771 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:01.964291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:01.964965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:01.965256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:01.965543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:01.966309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:01.966623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:01.968067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:01.986124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 27/50] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:01.987715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:02.086913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c354f-44b6-4714-af35-7e32ca38d903 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:02.119431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:02.120822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.121104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.121382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.122562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:02.124045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:02.125668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 24/51] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:01 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:02.131029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:02.231030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.236364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f293356-1ac0-4e1b-b952-d6ef8d892966 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:02.269446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245637-6718-434b-8f8e-fd94c1d34b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:02.270236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245637-6718-434b-8f8e-fd94c1d34b18 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.270528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245637-6718-434b-8f8e-fd94c1d34b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.270799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245637-6718-434b-8f8e-fd94c1d34b18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.271998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245637-6718-434b-8f8e-fd94c1d34b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:02.273458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245637-6718-434b-8f8e-fd94c1d34b18 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:02.275069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 28/52] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:02.280807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:02.329220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.347030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b865-ac69-4e4c-83f0-e7279f6a99e0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.347030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b865-ac69-4e4c-83f0-e7279f6a99e0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.347030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b865-ac69-4e4c-83f0-e7279f6a99e0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.347030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 29/53] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:02.349995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.350293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.350580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.369683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:02.371509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:02.387783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a30ef-e580-4fa0-ab39-9cba8cbe5cfb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:02.422130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:02.422803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.423087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.423395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.424232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.domain.id=default, user.id=f9d0e31020494ca584e4bf621abe8d70) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:02.424542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:02.425983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:02.434498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 25/54] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 23 15:22:02 2022] GET /identity/v3/role_assignments?user.id=f9d0e31020494ca584e4bf621abe8d70&scope.domain.id=default&role.id=cc12091eec434ea294a879c1b207931e => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:02.447064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 30/55] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:02.470426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:02.574374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcf1b3-9abd-4626-80c6-5dd4dc82c3dd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:02.588216 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.610104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37c89-451b-4111-81cc-471374ccda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:02.610837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37c89-451b-4111-81cc-471374ccda16 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.611140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37c89-451b-4111-81cc-471374ccda16 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.611424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37c89-451b-4111-81cc-471374ccda16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.612611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb37c89-451b-4111-81cc-471374ccda16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:02.614068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb37c89-451b-4111-81cc-471374ccda16 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:02.615871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 26/56] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:02.621904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:02.714917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.723379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde18c2-d902-4c45-84c8-162de2b397a3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:02.759777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed7cf-9cf2-4b8c-b56c-ac677b726caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:02.760482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed7cf-9cf2-4b8c-b56c-ac677b726caf None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:02.760772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed7cf-9cf2-4b8c-b56c-ac677b726caf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:02.761055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed7cf-9cf2-4b8c-b56c-ac677b726caf None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:02.761759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ed7cf-9cf2-4b8c-b56c-ac677b726caf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:02.763245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ed7cf-9cf2-4b8c-b56c-ac677b726caf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:02.850674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 31/57] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 23 15:22:02 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:05.068229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e310-a709-4cd2-b091-dcfb8786497b None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:05.068770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e310-a709-4cd2-b091-dcfb8786497b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:05.068770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e310-a709-4cd2-b091-dcfb8786497b None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:05.070151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 27/58] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:05.075949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:05.076348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:05.076525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:05.092854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:05.094045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:05.158005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 32/59] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:05.181989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2e310-a709-4cd2-b091-dcfb8786497b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:05.282279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2e310-a709-4cd2-b091-dcfb8786497b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:05.315117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3b91-7eba-4270-87de-363f0bf46375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:05.315923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3b91-7eba-4270-87de-363f0bf46375 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:05.316212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3b91-7eba-4270-87de-363f0bf46375 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:05.316492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3b91-7eba-4270-87de-363f0bf46375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:05.317667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c3b91-7eba-4270-87de-363f0bf46375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:05.319173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c3b91-7eba-4270-87de-363f0bf46375 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:05.320736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 28/60] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:05.326230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:05.397358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:05.426534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a30b7-119c-46b1-9259-6463366bef42 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:05.459673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee519ad-75a2-4361-a3a8-6b726e7b71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:05.460413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee519ad-75a2-4361-a3a8-6b726e7b71e3 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:05.460703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee519ad-75a2-4361-a3a8-6b726e7b71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:05.460982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee519ad-75a2-4361-a3a8-6b726e7b71e3 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:05.461690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee519ad-75a2-4361-a3a8-6b726e7b71e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:05.463167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee519ad-75a2-4361-a3a8-6b726e7b71e3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:05.552301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 33/61] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:05 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:08.918542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4763e7d-11cc-49bb-af17-bf257f7cd3da None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:08.919481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4763e7d-11cc-49bb-af17-bf257f7cd3da None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:08.919922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4763e7d-11cc-49bb-af17-bf257f7cd3da None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:08.921896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 29/62] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:08.927052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:08.927911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:08.928345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:08.956307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:08.957764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:09.013693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703ebc-f2f4-4f20-9830-0dbb1eb8ee08 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.014244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703ebc-f2f4-4f20-9830-0dbb1eb8ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.014677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703ebc-f2f4-4f20-9830-0dbb1eb8ee08 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.016230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 30/63] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:09.023008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.023567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.024048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.041688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:09.043313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:09.060752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 34/64] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:09.092819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.094019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.126735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 31/65] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:09.150868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.223874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.273676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619c242-888b-4a67-a047-b4d7b8383288 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.312237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:09.313300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.313723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.314135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.328478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:09.332967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93509b8c-0d65-45a2-9c0e-b283c5353983 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:09.344955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:09.346071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:09.347016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:09.351201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 32/66] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:09.356707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.400381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.414826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30319-5e4d-4c2b-b4f0-9f4e7d78870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:09.416047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30319-5e4d-4c2b-b4f0-9f4e7d78870b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.416047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30319-5e4d-4c2b-b4f0-9f4e7d78870b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.416252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30319-5e4d-4c2b-b4f0-9f4e7d78870b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.439218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30319-5e4d-4c2b-b4f0-9f4e7d78870b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f7c30319-5e4d-4c2b-b4f0-9f4e7d78870b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:09.448754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:09.449770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:09.450628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 35/67] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:09.451367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb2ab4-0974-47ca-846b-8abf2a04eb84 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.451728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb2ab4-0974-47ca-846b-8abf2a04eb84 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.452017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb2ab4-0974-47ca-846b-8abf2a04eb84 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.453338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 36/68] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:09.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb2ab4-0974-47ca-846b-8abf2a04eb84 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.470516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845062-7278-46dc-95a4-bcf13ba32d4f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.507397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:09.508077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.508366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.509055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.509818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:09.510133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:09.512323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d08c6d-30f0-48e5-bfa2-3bd40ce6ca06 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:09.524016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 33/69] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:09.525526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a2390-c27a-4932-bff0-5e5919137311 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.526462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a2390-c27a-4932-bff0-5e5919137311 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.526801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a2390-c27a-4932-bff0-5e5919137311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.543670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a94a2390-c27a-4932-bff0-5e5919137311 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:09.544846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a94a2390-c27a-4932-bff0-5e5919137311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:09.577993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb2ab4-0974-47ca-846b-8abf2a04eb84 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.599773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.612800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 34/70] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:09.614120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90b0c7-d0cc-40c2-8ac4-802d3b8f5474 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.614412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90b0c7-d0cc-40c2-8ac4-802d3b8f5474 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.614623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:09.614735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90b0c7-d0cc-40c2-8ac4-802d3b8f5474 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.615329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.615622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.619331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.619464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 35/71] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:09.619464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90b0c7-d0cc-40c2-8ac4-802d3b8f5474 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.619628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:09.619628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:09.619628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ece8-a6ea-4d63-9691-b813782d211b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:09.628378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:09.629710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae879a3-d81b-4a23-bafd-ba1ab0a0f9ad None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.630008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae879a3-d81b-4a23-bafd-ba1ab0a0f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.630291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae879a3-d81b-4a23-bafd-ba1ab0a0f9ad None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.631548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 38/73] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:09.632701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.633006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.633304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.650125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:09.651893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:09.655319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.720072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 39/74] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:09.720765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.735694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90b0c7-d0cc-40c2-8ac4-802d3b8f5474 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.769709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021ef5-ad26-43f2-b976-2bea6d37dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:09.770514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021ef5-ad26-43f2-b976-2bea6d37dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.770801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021ef5-ad26-43f2-b976-2bea6d37dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.771076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021ef5-ad26-43f2-b976-2bea6d37dcf8 None admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.772306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021ef5-ad26-43f2-b976-2bea6d37dcf8 None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:09.773760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021ef5-ad26-43f2-b976-2bea6d37dcf8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:09.775436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 36/75] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:09.777233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.777529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.777831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.795637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:09.796818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:09.818078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf413-d005-44c4-b2b1-0745385b10e9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.830987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.852364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:09.853289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:09.853579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:09.853862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:09.861904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 37/76] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:09.862716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.870739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:09.872352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:09.878305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 40/77] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:09.878305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:09.896286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:09.967992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf71f1-0bd4-41e8-a4fd-1e01e5689041 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:09.973175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6aeb2-04e3-4ee5-a6f6-800dbdbd5767 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.001523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.001817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.002095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.003300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.004749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.006538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 38/78] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:10.006638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.007225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.007327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.007520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.007807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.020242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:10.028987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:10.030034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:10.030825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 41/79] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:10.031504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.062220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.118260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.124416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f156f-45a9-4d5c-9bbc-17a512c33948 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.134137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f81d6-ea78-46b5-8303-e86f5484afd9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.157264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.157909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.158197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.158483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.167678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.168376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.168674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.168956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.224375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.225832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.236868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.238345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.267651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.316659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.323517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 39/80] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:10.324367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.339054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 42/81] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:10.339872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.420523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01acf-05b8-4082-8a79-f258ae10d087 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.437910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371638c-e13a-4334-83b3-5708f3dcc678 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.453735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.454540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.454829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.455134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.464754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.465094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:10.471085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.471787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.472079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.472363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.473086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.474879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:10.475884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:10.477154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:10.477889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:10.478458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 40/82] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:10.480070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.538689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.558956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 43/83] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:10 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:10.559655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.590829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78e1de-c3e7-49e5-b568-9338658f2825 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.631920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.632616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.632912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.633199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.633977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:10.634296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.635819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.650625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 41/84] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:10.650625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.689629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954cda1-0c06-4e43-9b4a-c46c88001da3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.752044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.752930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.753221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.753500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.755047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.756229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.758102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 44/85] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:10.758704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.788848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbedbd-b548-4a2e-8271-f7a5e182334a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.818805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.827428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:10.837948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.840816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.840816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.841045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.842868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.843746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.845504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 42/86] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:10.846299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.883920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6fdc-7d96-4725-9d58-8969613dd3c1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:10.925169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:10.926828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:10.927366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:10.927843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:10.929155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:10.929697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:10.931961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:10.943280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 45/87] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:10.944752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:10.972053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a40ebb-daa1-4213-b5a7-5d6f0bf0cb2d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.009513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:11.010830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:11.011354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:11.011852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:11.013269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:11.014955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:11.017169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 43/88] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:11.018146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:11.065823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a195-57d8-4543-b739-078d1d9e2adc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.081592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:11.084642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:11.104766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:11.105352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:11.105654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:11.105940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:11.106795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=f9d0e31020494ca584e4bf621abe8d70) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:11.107126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:11.108608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:11.115076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 46/89] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:10 2022] GET /identity/v3/role_assignments?user.id=f9d0e31020494ca584e4bf621abe8d70&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:11.115775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:11.136676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c47a-6dc7-4297-8108-ff48b6670284 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.175960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:11.176701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:11.176991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:11.177273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:11.178194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=e2e7fa675dcd45a998f96ffcdc103e59) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:11.178518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:11.180126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:11.186743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 44/90] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:11 2022] GET /identity/v3/role_assignments?user.id=e2e7fa675dcd45a998f96ffcdc103e59&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:11.187593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:11.287838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96887abc-f953-46ac-b0a9-fddddeabc77d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.349390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accb6d1-1bc7-498b-a8ce-5f6e57969a2a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.351542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:11.352606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:11.352894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:11.353171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:11.355979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:11.357438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:11.359390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 47/91] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:11 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:11.374356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:11.379042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:11.393839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:11.394603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:11.394902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:11.395228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:11.481908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:11.512769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:11.514445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:11.587970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b33df-f216-42a1-9100-0d243117dd4d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.659633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:11.660194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:11.660485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:11.660770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:11.707487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 45/92] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:11.709873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:11.758335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:11.833709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:11.835243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:11.929979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ed0eb-6ce6-487a-9a1c-9708e8c7a015 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:11.951223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:12.016356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:12.017248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.017533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.017813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.023868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:12.025367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:12.027902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 46/93] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:11 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:12.033535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:12.056599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 48/94] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:12.062359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:12.274460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6972f6-6cc6-40ec-885c-b49b65b1eedf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:12.275460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:12.316206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c064b-dcd9-4a18-80cd-41325914b160 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:12.347552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:12.348438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.348986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.349268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] PATH_INFO: `/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.353091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] RBAC: Authorizing `identity:get_project(project_id=c6e2dc2f3bf5488c8c9064aeecc717f1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:12.354598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:12.357145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 49/95] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:12 2022] GET /identity/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:12.362950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:12.420420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:12.421378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:12.421509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.421509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.421648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.423130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] RBAC: Adding query filter params (role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=e2e7fa675dcd45a998f96ffcdc103e59) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:12.423130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:12.424302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b6a1a-de9e-4def-8d24-4f42eb1fc809 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:12.442280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 47/96] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:12 2022] GET /identity/v3/role_assignments?user.id=e2e7fa675dcd45a998f96ffcdc103e59&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=825ed394374246a6a9348bca22ceafae => generated 259 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:12.601872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5578-76a2-47a1-bfc8-7cd4ce09f287 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:12.659955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:12.660666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.660963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.661252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.662122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=c6e2dc2f3bf5488c8c9064aeecc717f1, user.id=e2e7fa675dcd45a998f96ffcdc103e59) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:12.662442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:12.663967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57231d36-c936-401e-be01-9b2989aee0e5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:12.671163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 50/97] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:12 2022] GET /identity/v3/role_assignments?user.id=e2e7fa675dcd45a998f96ffcdc103e59&scope.project.id=c6e2dc2f3bf5488c8c9064aeecc717f1&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:13.663714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba29be-fbd2-46f6-ac11-74a1805c7b9b None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:13.664234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba29be-fbd2-46f6-ac11-74a1805c7b9b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:13.664234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba29be-fbd2-46f6-ac11-74a1805c7b9b None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:13.665564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 48/98] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:13.677574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:13.678564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:13.679045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:13.704167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:13.705734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:13.784318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b99dbd-7cea-4b7e-a603-c97ce7fcb7f2 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:13.784645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b99dbd-7cea-4b7e-a603-c97ce7fcb7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:13.784896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b99dbd-7cea-4b7e-a603-c97ce7fcb7f2 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:13.786282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 49/99] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:13.792786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:13.793087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:13.793375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:13.801347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 51/100] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:13.828107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:13.829323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:13.842775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:13.863705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:13.961954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 50/101] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:14.004529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.042199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251e29-bcdf-4eea-a5f9-c14e8ea5dbec None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.106768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.107601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.107958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.108246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.109576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:14.111133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:14.113007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 52/102] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:14.119065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.147726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:14.168557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a46865-9548-4403-a0b6-f935ab6828cc None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.213943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7239aa0-9ab8-4145-897c-78639aa53329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.214671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7239aa0-9ab8-4145-897c-78639aa53329 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.214956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7239aa0-9ab8-4145-897c-78639aa53329 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.215263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7239aa0-9ab8-4145-897c-78639aa53329 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.228122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:14.244111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7239aa0-9ab8-4145-897c-78639aa53329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-c7239aa0-9ab8-4145-897c-78639aa53329 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:14.252161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:14.253048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:14.254412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:14.261277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4870c2-659a-4ab9-8392-9f10480a96e7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.266388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 51/103] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:14.266388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4022653-47f5-4f79-b5a1-dd0ec2dd852e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.266388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4022653-47f5-4f79-b5a1-dd0ec2dd852e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.266388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4022653-47f5-4f79-b5a1-dd0ec2dd852e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.266388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 52/104] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:14.270229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4022653-47f5-4f79-b5a1-dd0ec2dd852e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.312516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592788ca-46bf-4339-8ed6-429f1a822190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.313453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592788ca-46bf-4339-8ed6-429f1a822190 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.314433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592788ca-46bf-4339-8ed6-429f1a822190 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.314929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592788ca-46bf-4339-8ed6-429f1a822190 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.315865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592788ca-46bf-4339-8ed6-429f1a822190 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:14.317608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592788ca-46bf-4339-8ed6-429f1a822190 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:14.425918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4022653-47f5-4f79-b5a1-dd0ec2dd852e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.462751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 53/105] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:22:14 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:14.465312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add428d-7eeb-4c4a-8ffa-caa13574dd7e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.465748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add428d-7eeb-4c4a-8ffa-caa13574dd7e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.466522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add428d-7eeb-4c4a-8ffa-caa13574dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.486673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.487631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.488055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.488480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.489439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:14.489888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:14.491490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3940e-6d7d-4261-9fba-b9321600322f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:14.502108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1add428d-7eeb-4c4a-8ffa-caa13574dd7e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:14.505142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1add428d-7eeb-4c4a-8ffa-caa13574dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:14.515985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 53/106] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:14.515985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232d94f-bdfc-48ba-98cf-c5ac0cd0d153 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.515985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232d94f-bdfc-48ba-98cf-c5ac0cd0d153 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.515985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232d94f-bdfc-48ba-98cf-c5ac0cd0d153 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.515985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 54/107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:14.519864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232d94f-bdfc-48ba-98cf-c5ac0cd0d153 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.523273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:14.627427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 54/108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:14.629413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.629915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.630390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.679143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:14.681495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:14.717900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232d94f-bdfc-48ba-98cf-c5ac0cd0d153 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.762905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.763992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.764301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.764587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] PATH_INFO: `/v3/users/9a5b901c1b7e45f8a6850fa7f2042b45` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.786994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] RBAC: Authorizing `identity:get_user(user_id=9a5b901c1b7e45f8a6850fa7f2042b45)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:14.788902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:14.795086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 55/109] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:14 2022] GET /identity/v3/users/9a5b901c1b7e45f8a6850fa7f2042b45 => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:14.795086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.805028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:14.819185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 55/110] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:14.823492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.862623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:14.926941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aa0cf-e819-48d4-b56f-b80d3d6add57 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.945514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93c880-0884-4d4b-b419-424ea2b4eda2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.981610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.982283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.982577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.982863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.007251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.008064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.008357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.008637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.035894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:15.054099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:15.054983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:15.056278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:15.056867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:15.060004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.060237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 56/111] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:15.061417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.061517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.170679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 56/112] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:15.170679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.215136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be4f14-f457-4bcc-9af4-b63a1e8d564c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.254651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.255983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.256466 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.256938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.269192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:15.278883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:15.279788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:15.280535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:15.283199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 57/113] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:15.287308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:15.288658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.402637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ea27-fd57-4e9f-9e69-ee8ab10b3147 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.439226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:15.441657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.442670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.443064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.443493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.445255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.447014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.454558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 58/114] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:15.455915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.473240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566b9c-c670-4974-b590-3efb384a8653 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.523636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:15.572737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ecb01-2fd2-4584-8318-cad3c30255de None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.575256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.575951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.576242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.576526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.577298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:15.577616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.579114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.601312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 57/115] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:15.602158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.612917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.613608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.614057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.614431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.615228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:15.615548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.617030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.629147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 59/116] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:15.629999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.754535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6fde-d38a-4f52-ab83-061e1f5a8f71 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.796389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.797743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.798038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.798326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.800033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.801930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.804291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 60/117] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:15.805932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.818021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:15.829702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179736-6fe3-42b0-84cd-67104423a9f7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.873400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.874064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.874351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.874631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.875500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] RBAC: Adding query filter params (role.id=d3131ec4431541ca89f6192831c24667, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=9a5b901c1b7e45f8a6850fa7f2042b45) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:15.875815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.877266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15db0b-68b6-4203-92a9-8be9d601db07 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.883090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 58/118] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/role_assignments?user.id=9a5b901c1b7e45f8a6850fa7f2042b45&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=d3131ec4431541ca89f6192831c24667 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:15.884422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622ea6-9f3b-4b9b-8d70-33a3403c50f9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.884715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622ea6-9f3b-4b9b-8d70-33a3403c50f9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.884997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622ea6-9f3b-4b9b-8d70-33a3403c50f9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.886779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 59/119] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:15.887547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c622ea6-9f3b-4b9b-8d70-33a3403c50f9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:15.914191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:15.943384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd491-0d22-4736-81fd-59ba28951c3e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:15.988653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b77d80-ed9e-4154-95aa-051572ef6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:15.989561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b77d80-ed9e-4154-95aa-051572ef6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.989855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b77d80-ed9e-4154-95aa-051572ef6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.990184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b77d80-ed9e-4154-95aa-051572ef6fb4 None admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.991614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b77d80-ed9e-4154-95aa-051572ef6fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:15.993284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b77d80-ed9e-4154-95aa-051572ef6fb4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:15.995111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 61/120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:15.996570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b121b8-1352-4ff4-bd23-1bd5f9fe9544 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:15.996869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b121b8-1352-4ff4-bd23-1bd5f9fe9544 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:15.997190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b121b8-1352-4ff4-bd23-1bd5f9fe9544 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:15.999022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 62/121] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:16.000027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.000323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.000608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.020122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:16.021466 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:16.043265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c622ea6-9f3b-4b9b-8d70-33a3403c50f9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.074299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:16.092268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389028-2699-4b41-985a-47867ea05daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.093142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389028-2699-4b41-985a-47867ea05daa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.093911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389028-2699-4b41-985a-47867ea05daa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.093911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389028-2699-4b41-985a-47867ea05daa None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.095113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99389028-2699-4b41-985a-47867ea05daa None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:16.096591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99389028-2699-4b41-985a-47867ea05daa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:16.098440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 60/122] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:15 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:16.099887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.100149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.100431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.101997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 63/123] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:16.106701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.132142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:16.133350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:16.219875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a1d9f-236f-4dad-89b7-835d74fe56e5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.224211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 61/124] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:16.225133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.243367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:16.257490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.258367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.258659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.259007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.266093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:16.266093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:16.266093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 64/125] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:16 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:16.266093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.325610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:16.346438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458814-7aa3-468a-8c69-d61f86a16b43 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.385762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.386664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.387007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.387323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/e2e7fa675dcd45a998f96ffcdc103e59/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.389657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] RBAC: Authorizing `identity:create_grant(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c, user_id=e2e7fa675dcd45a998f96ffcdc103e59, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:16.391203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:16.395085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e660-9860-4498-9881-e2f75a2bf80c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.431287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.432885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.433173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.433451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.444062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:16.452234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:16.453114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:16.454010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:16.457304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 65/126] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:16.458354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.495671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 62/127] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:16 2022] PUT /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/e2e7fa675dcd45a998f96ffcdc103e59/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:16.496301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.603223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:16.634172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b695-a6bb-48e6-b897-6973bf7b563e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.661739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378502-890e-4b17-8110-35ce4d2cc68f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.668027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:16.685820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.687168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.687683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.689232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/f9d0e31020494ca584e4bf621abe8d70/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.693727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] RBAC: Authorizing `identity:create_grant(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c, user_id=f9d0e31020494ca584e4bf621abe8d70, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:16.697269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:16.724438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.725645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.726187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.726659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.740562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:16.750889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:16.751850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:16.752646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:16.755235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 66/128] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:16.756977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.802195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 63/129] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:16 2022] PUT /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/f9d0e31020494ca584e4bf621abe8d70/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:16.803166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.892397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa284fd-3df8-4783-9942-41b437100ff7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.937905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:16.939075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.939582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.940051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.940999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:16.941606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:16.943372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:16.953377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 67/130] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:16.960270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:16.973144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33609ee-3854-4721-8af8-c8fb0ac35d47 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:16.997110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:17.013227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.013922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.014269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.014556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.015402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:17.015676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.017112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.018678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:17.027672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 64/131] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:17.038677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.147384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e032402-391d-4c91-a0e1-cd29ae3ff77d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.186076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fbae2-1998-4520-b69c-951afd064872 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.204934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.205842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.206127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.206410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.212066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.214154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.219252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 68/132] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:16 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:17.233106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.234073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.234360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.234638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.235967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.237436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.239850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.240048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 65/133] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:17 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:17.247641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.330119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:17.342750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:17.362255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac43056-2f23-4f80-beec-1772d9543f30 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.390627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b9cce-396b-42cd-aa16-aaac65de57c5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.428447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a081c-5eff-4b06-b205-6af364cdd2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.429648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a081c-5eff-4b06-b205-6af364cdd2bf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.430154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a081c-5eff-4b06-b205-6af364cdd2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.430645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a081c-5eff-4b06-b205-6af364cdd2bf None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.433212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a081c-5eff-4b06-b205-6af364cdd2bf None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.434869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a081c-5eff-4b06-b205-6af364cdd2bf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.437547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 69/134] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:17 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:17.439717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab768-2220-439d-8b91-8f34e8cdf4c2 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.440382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab768-2220-439d-8b91-8f34e8cdf4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.441993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab768-2220-439d-8b91-8f34e8cdf4c2 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.444203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 70/135] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:17.445746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab768-2220-439d-8b91-8f34e8cdf4c2 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.461739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2d0bc-f675-46be-b5b2-79d3a438407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.462946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d0bc-f675-46be-b5b2-79d3a438407f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.464009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d0bc-f675-46be-b5b2-79d3a438407f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.464486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d0bc-f675-46be-b5b2-79d3a438407f None admin] PATH_INFO: `/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.467786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2d0bc-f675-46be-b5b2-79d3a438407f None admin] RBAC: Authorizing `identity:get_project(project_id=c6e2dc2f3bf5488c8c9064aeecc717f1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.469468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2d0bc-f675-46be-b5b2-79d3a438407f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.471446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 66/136] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:17 2022] GET /identity/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1 => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:17.473208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.473973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.474469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.492890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:17.494927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:17.608201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 67/137] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:17.610380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.652164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab768-2220-439d-8b91-8f34e8cdf4c2 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.696305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.697129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.697411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.698309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/e2e7fa675dcd45a998f96ffcdc103e59/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.700573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] RBAC: Authorizing `identity:create_grant(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c, user_id=e2e7fa675dcd45a998f96ffcdc103e59, role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.702028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.729697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:17.769971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bca50a-45bc-4ab7-9bf3-a63f576b184c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.781130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 71/138] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:17 2022] PUT /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/e2e7fa675dcd45a998f96ffcdc103e59/roles/825ed394374246a6a9348bca22ceafae => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:17.785675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.849937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:17.871221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.872137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.872424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.872700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] PATH_INFO: `/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1/users/e2e7fa675dcd45a998f96ffcdc103e59/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.877150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6e2dc2f3bf5488c8c9064aeecc717f1, user_id=e2e7fa675dcd45a998f96ffcdc103e59, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.878725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.963560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a3e59-0bfe-4332-a88e-24baa010ec6b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.975508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 68/139] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:17 2022] PUT /identity/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1/users/e2e7fa675dcd45a998f96ffcdc103e59/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:18.005809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684bac6-cb10-46f7-b135-d386e2191217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:18.006688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684bac6-cb10-46f7-b135-d386e2191217 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:18.006980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684bac6-cb10-46f7-b135-d386e2191217 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:18.007327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684bac6-cb10-46f7-b135-d386e2191217 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:18.008618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684bac6-cb10-46f7-b135-d386e2191217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:18.010347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684bac6-cb10-46f7-b135-d386e2191217 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:18.012699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 72/140] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:18.017955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:18.151359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4461c6-a2b8-446c-af50-4f5e004d2ae8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:18.184778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:18.197071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20f18-0839-42b0-a884-0daf5de0aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:18.197913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20f18-0839-42b0-a884-0daf5de0aa10 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:18.198206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20f18-0839-42b0-a884-0daf5de0aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:18.198487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20f18-0839-42b0-a884-0daf5de0aa10 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:18.199271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20f18-0839-42b0-a884-0daf5de0aa10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:18.200748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c20f18-0839-42b0-a884-0daf5de0aa10 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:18.318897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 69/141] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:18 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:18.620183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872360-1276-46f7-824b-88c6c17a3f5d None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:18.621020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872360-1276-46f7-824b-88c6c17a3f5d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:18.621518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872360-1276-46f7-824b-88c6c17a3f5d None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:18.623158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 73/142] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:18.628954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:18.629561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:18.630172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:18.655260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:18.656799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:18.733615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 70/143] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:18.778042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872360-1276-46f7-824b-88c6c17a3f5d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:18.882563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:18.898454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872360-1276-46f7-824b-88c6c17a3f5d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:18.945108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:18.945915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:18.946248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:18.946534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:18.958259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:18.970183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:18.971039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:18.972261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 74/144] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:18.977701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:19.089786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61271181-b7d2-498e-8f37-c4b317c85da1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:19.100345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:19.132514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:19.133263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.133499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.133777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.134549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:19.134863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:19.136895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:19.149058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 71/145] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:19.152239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:19.277189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4159cf-26b1-4db0-a42a-e85eb5b75dd7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:19.319373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:19.320267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.320560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.320840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] PATH_INFO: `/v3/users/9a5b901c1b7e45f8a6850fa7f2042b45` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.322069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] RBAC: Authorizing `identity:get_user(user_id=9a5b901c1b7e45f8a6850fa7f2042b45)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:19.324505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:19.326472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 75/146] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:19 2022] GET /identity/v3/users/9a5b901c1b7e45f8a6850fa7f2042b45 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:19.331733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:19.458965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a26c0d-f22b-4816-8fee-c4bd84bdb130 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:19.498814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8c6b-3d20-4e2e-87c7-7ef5bd4d8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:19.499764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8c6b-3d20-4e2e-87c7-7ef5bd4d8034 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.500057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8c6b-3d20-4e2e-87c7-7ef5bd4d8034 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.500339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8c6b-3d20-4e2e-87c7-7ef5bd4d8034 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.501687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc8c6b-3d20-4e2e-87c7-7ef5bd4d8034 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:19.503183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc8c6b-3d20-4e2e-87c7-7ef5bd4d8034 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:19.505125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 72/147] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:19 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:19.510616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:19.531304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:19.646481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdad70d-7160-4253-bf27-cd6d62f0878a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:19.693582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b3f9-490e-4b7b-92ef-37ce489785fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:19.694594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b3f9-490e-4b7b-92ef-37ce489785fb None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.694882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b3f9-490e-4b7b-92ef-37ce489785fb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.695188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b3f9-490e-4b7b-92ef-37ce489785fb None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/9a5b901c1b7e45f8a6850fa7f2042b45/roles/d3131ec4431541ca89f6192831c24667` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.697209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b3f9-490e-4b7b-92ef-37ce489785fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c, user_id=9a5b901c1b7e45f8a6850fa7f2042b45, role_id=d3131ec4431541ca89f6192831c24667)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:19.698705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b3f9-490e-4b7b-92ef-37ce489785fb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:19.831011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf5e93-6e65-4d32-898c-c9c915165060 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.831430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf5e93-6e65-4d32-898c-c9c915165060 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.831680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf5e93-6e65-4d32-898c-c9c915165060 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.833072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 73/148] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:19.838916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae7f0a-a98e-4dfe-983c-858084b01632 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.839233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae7f0a-a98e-4dfe-983c-858084b01632 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.839518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae7f0a-a98e-4dfe-983c-858084b01632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.861160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-acae7f0a-a98e-4dfe-983c-858084b01632 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:19.862471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-acae7f0a-a98e-4dfe-983c-858084b01632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:19.890198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 76/149] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:19 2022] PUT /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/users/9a5b901c1b7e45f8a6850fa7f2042b45/roles/d3131ec4431541ca89f6192831c24667 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:19.911243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:19.959627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 74/150] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:19.966940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaa71d-3a12-46ec-b66f-92f6b6319704 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.967313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaa71d-3a12-46ec-b66f-92f6b6319704 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.967604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaa71d-3a12-46ec-b66f-92f6b6319704 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.969234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 77/151] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:19.975358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.975689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.975929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.998393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:19.999693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:20.016899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaa71d-3a12-46ec-b66f-92f6b6319704 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.106311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 75/152] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:20.157409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.179141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:20.206619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaa71d-3a12-46ec-b66f-92f6b6319704 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:20.257340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:20.258498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:20.258974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:20.259468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:20.273309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:20.285100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:20.285987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:20.286731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:20.287345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fb3ff-fa71-494c-addc-585e2e07e887 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:20.287422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:20.289672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 78/153] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:20.294604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.346844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:20.347707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:20.348373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:20.348373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:20.364808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:20.376807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:20.377805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:20.379451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 76/154] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:20.385920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.487666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea173749-bd30-4550-9f3c-819ed2658c81 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:20.500130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5993-7fea-44c4-acb9-ccab51c927e1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:20.544075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:20.544774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:20.545061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:20.545346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:20.546124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:20.546558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:20.548016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:20.557933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 77/155] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:20.560258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:20.561436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:20.561725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:20.562141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:20.563947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:20.564273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:20.565689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:20.573549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.580099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:20.587339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 79/156] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:20.592990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.606626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:20.723894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d4bbc-8cb0-4fcb-8431-9c74afcfb2bd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:20.771084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:20.771990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:20.772279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:20.772560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] PATH_INFO: `/v3/users/f9d0e31020494ca584e4bf621abe8d70` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:20.779937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] RBAC: Authorizing `identity:get_user(user_id=f9d0e31020494ca584e4bf621abe8d70)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:20.781451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:20.783490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 78/157] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/users/f9d0e31020494ca584e4bf621abe8d70 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:20.791608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.798500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c87ec2-1091-4c32-b603-71d2480dcb6a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:20.840154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:20.841864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:20.842293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:20.842743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:20.844309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:20.846191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:20.848055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 80/158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:20.856086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:20.960637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:20.999853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:21.017780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6977ce-1cbf-42f6-9660-d7dff69eff84 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:21.027678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3d3cd-9b67-4b9e-b2a9-882b76716ead None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:21.068809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:21.070006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.070523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.070987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.105334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:21.106406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.107278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.108733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.206483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:21.208139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:21.218804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:21.220778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:21.322512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:21.337029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 79/159] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:21.342842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:21.376394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:21.454105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449481a-0780-4409-8062-90aa6c46ef01 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:21.456594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 81/160] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:21.462109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:21.507336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:21.507336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.507336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.507336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.508226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:21.510705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:21.512584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 80/161] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:21 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:21.518585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:21.614176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:21.645297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea6071-0dc9-46dc-a8e6-c1f4766bcad0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:21.678735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306b23-b990-492a-a0b3-65d71fb4d231 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:21.742678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:21.743568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.743853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.744132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.746689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:21.748192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:21.750076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 82/162] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:21 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:21.751552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:21.752228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.752481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.752768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.753595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=f9d0e31020494ca584e4bf621abe8d70) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:21.753909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:21.755395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f0422-9c7a-416e-adf6-47116e50a742 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:21.765677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:21.771459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 81/163] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:21 2022] GET /identity/v3/role_assignments?user.id=f9d0e31020494ca584e4bf621abe8d70&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:21.827530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:21.892701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bae23-343b-4793-a167-9859f0c8897c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.892993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bae23-343b-4793-a167-9859f0c8897c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.893155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bae23-343b-4793-a167-9859f0c8897c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.894795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 82/164] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:21.900624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.901414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.901692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.935685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:21.936925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:21.941263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38fed2-2dbe-44b3-9433-9263cd5644da None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:22.003820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:22.005308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:22.005594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:22.005869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:22.006719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=e2e7fa675dcd45a998f96ffcdc103e59) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:22.007034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:22.011120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:22.030296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 83/165] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:21 2022] GET /identity/v3/role_assignments?user.id=e2e7fa675dcd45a998f96ffcdc103e59&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:22.057474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 83/166] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:22.118646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:22.256004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e902-4c5e-441d-a84b-395095a7e261 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:22.259434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:22.310712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:22.311619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:22.311903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:22.312178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:22.325462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:22.333586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:22.334527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:22.335433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 84/167] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:22.344522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:22.428652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:22.487477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f54b9e-44f4-4500-b4a3-6c333438cb29 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:22.525934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:22.526612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:22.526894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:22.527212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:22.527987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:22.528293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:22.529742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8aee0-c949-4896-9784-6d44e9c584f4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:22.540753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 84/168] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:22.546440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:22.561371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58839b-ea31-4c01-825b-aa1bad548781 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:22.561685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58839b-ea31-4c01-825b-aa1bad548781 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:22.561925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58839b-ea31-4c01-825b-aa1bad548781 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:22.563529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 85/169] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:22.579878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:22.580165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:22.580431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:22.601243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:22.602749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:22.746144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 86/170] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:22.757364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2409b-2b4f-4145-a3ac-67f3394edb70 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:22.791829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:22.832245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:22.833152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:22.833436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:22.833712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:22.835147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:22.836628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:22.838809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 85/171] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:22 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:22.844680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:22.865649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:22.900161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:23.005184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9da77-c45c-410e-89a4-3f8e66073c4c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:23.072778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dff8b-e986-4c2e-9ce2-2e30421f5be1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:23.087709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:23.089048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.089334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.089611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.116043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:23.125923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:23.126812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:23.127646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:23.130022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 87/172] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:23.139768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:23.163882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce956709-3332-428f-9de1-634950827f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:23.164557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce956709-3332-428f-9de1-634950827f06 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.164846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce956709-3332-428f-9de1-634950827f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.165127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce956709-3332-428f-9de1-634950827f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.328273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce956709-3332-428f-9de1-634950827f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:23.330122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce956709-3332-428f-9de1-634950827f06 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:23.379627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39f88-3752-420c-a4c4-7dd9efe0a228 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:23.381667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:23.411494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:23.459850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:23.460545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.460839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.461121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.461895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:23.462206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:23.464204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:23.478515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 88/173] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:23.484256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:23.569369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 86/174] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:23.575058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce956709-3332-428f-9de1-634950827f06 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:23.716132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce956709-3332-428f-9de1-634950827f06 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:23.757230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81945f7d-ac9a-45d0-8ebe-8d203bd383d8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:23.763514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:23.771516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6442543-6970-44fb-8f16-55404cfd6561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:23.772656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442543-6970-44fb-8f16-55404cfd6561 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.773100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442543-6970-44fb-8f16-55404cfd6561 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.779878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442543-6970-44fb-8f16-55404cfd6561 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.779878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6442543-6970-44fb-8f16-55404cfd6561 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:23.779878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6442543-6970-44fb-8f16-55404cfd6561 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:23.780932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 87/175] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:23 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:23.783040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32752e-dfbd-4c6c-9687-5c13a7e34a10 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.783356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32752e-dfbd-4c6c-9687-5c13a7e34a10 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.783637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32752e-dfbd-4c6c-9687-5c13a7e34a10 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.784910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 88/176] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:23.790170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32752e-dfbd-4c6c-9687-5c13a7e34a10 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:23.813704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cdf5b-58ed-4136-92a5-555075dd2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:23.814609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cdf5b-58ed-4136-92a5-555075dd2e76 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.814889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cdf5b-58ed-4136-92a5-555075dd2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.815190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cdf5b-58ed-4136-92a5-555075dd2e76 None admin] PATH_INFO: `/v3/users/e2e7fa675dcd45a998f96ffcdc103e59` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.816685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cdf5b-58ed-4136-92a5-555075dd2e76 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e7fa675dcd45a998f96ffcdc103e59)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:23.818364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cdf5b-58ed-4136-92a5-555075dd2e76 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:23.820379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 89/177] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:23 2022] GET /identity/v3/users/e2e7fa675dcd45a998f96ffcdc103e59 => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:23.821933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:23.822978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:23.823420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:23.843605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:23.845414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:23.876102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:23.921330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 90/178] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:23.922981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.034871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c44ea-fac5-4216-b04d-b8a13b931897 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.036989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32752e-dfbd-4c6c-9687-5c13a7e34a10 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.072654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57830805-d2e4-46c2-b2e9-3780a3bb7de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.073308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57830805-d2e4-46c2-b2e9-3780a3bb7de2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.073589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57830805-d2e4-46c2-b2e9-3780a3bb7de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.073861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57830805-d2e4-46c2-b2e9-3780a3bb7de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.076436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.077215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.077507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.077789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.078631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] RBAC: Adding query filter params (role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=e2e7fa675dcd45a998f96ffcdc103e59) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:24.078944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.080431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.087034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 89/179] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:23 2022] GET /identity/v3/role_assignments?user.id=e2e7fa675dcd45a998f96ffcdc103e59&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=825ed394374246a6a9348bca22ceafae => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:24.087880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.124500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.162835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.169096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57830805-d2e4-46c2-b2e9-3780a3bb7de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.170598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57830805-d2e4-46c2-b2e9-3780a3bb7de2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.212889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc7077-5bf0-4abc-a0eb-99816ae7d9e7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.259555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84947ae2-2694-465a-a0e1-af213e0afd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.260847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84947ae2-2694-465a-a0e1-af213e0afd62 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.261307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84947ae2-2694-465a-a0e1-af213e0afd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.261754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84947ae2-2694-465a-a0e1-af213e0afd62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.274360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84947ae2-2694-465a-a0e1-af213e0afd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-84947ae2-2694-465a-a0e1-af213e0afd62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:24.283380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:24.284245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:24.285065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:24.287026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 90/180] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:24.288419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e325a-93a6-4a44-b45c-9ee88753a146 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.288843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e325a-93a6-4a44-b45c-9ee88753a146 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.288985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 91/181] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:24.289369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e325a-93a6-4a44-b45c-9ee88753a146 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.292079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 91/182] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:24.293075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c877-e320-49c8-9478-730d6eb0d9f5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.293311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0d2f-cd44-4dce-94d1-ca0db5cbb963 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.293592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0d2f-cd44-4dce-94d1-ca0db5cbb963 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.293869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0d2f-cd44-4dce-94d1-ca0db5cbb963 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.293995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c877-e320-49c8-9478-730d6eb0d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.294450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c877-e320-49c8-9478-730d6eb0d9f5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.295089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 92/183] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:24.295962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0d2f-cd44-4dce-94d1-ca0db5cbb963 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.296251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 92/184] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:24.297199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c877-e320-49c8-9478-730d6eb0d9f5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.371592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.410474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0d2f-cd44-4dce-94d1-ca0db5cbb963 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.411384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c877-e320-49c8-9478-730d6eb0d9f5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.430285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.443818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4b27-bb59-4e58-897f-ce1c74901756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.443964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.444615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.444707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4b27-bb59-4e58-897f-ce1c74901756 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.444904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.446228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4b27-bb59-4e58-897f-ce1c74901756 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.446324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.446404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4b27-bb59-4e58-897f-ce1c74901756 None admin] PATH_INFO: `/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.446482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:24.446482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.446635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4b27-bb59-4e58-897f-ce1c74901756 None admin] RBAC: Authorizing `identity:get_project(project_id=c6e2dc2f3bf5488c8c9064aeecc717f1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.447741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239df50-d076-45e6-896b-9fdc8d365f2c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.447914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4b27-bb59-4e58-897f-ce1c74901756 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.449615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 93/185] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/projects/c6e2dc2f3bf5488c8c9064aeecc717f1 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:24.449615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4a30-7e4d-40b8-a7d5-6dcb89b06da1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.449615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4a30-7e4d-40b8-a7d5-6dcb89b06da1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.449615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4a30-7e4d-40b8-a7d5-6dcb89b06da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.456558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 93/186] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:24.462262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.462561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.462850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.468088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-682f4a30-7e4d-40b8-a7d5-6dcb89b06da1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:24.469277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-682f4a30-7e4d-40b8-a7d5-6dcb89b06da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:24.480514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:24.481675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:24.536243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 94/187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:24.537466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.537773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.538051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.546235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 94/188] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:24.547276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.564848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:24.566050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:24.622726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.640097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 95/189] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:24.640944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.654260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe91ad-9a6b-4bd7-82c0-8897cb3b0d49 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.722920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.744051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.744756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.745044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.745325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.746163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=c6e2dc2f3bf5488c8c9064aeecc717f1, user.id=e2e7fa675dcd45a998f96ffcdc103e59) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:24.746479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.747951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.753689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 95/190] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/role_assignments?user.id=e2e7fa675dcd45a998f96ffcdc103e59&scope.project.id=c6e2dc2f3bf5488c8c9064aeecc717f1&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:24.753689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.819769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c546a65-539c-4f01-8554-e7a64797289e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.857793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.858798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.859083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.859389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] PATH_INFO: `/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.870530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ba8c-a77b-49e8-a9ed-25aa7b63d807 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.875040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] RBAC: Authorizing `identity:get_user(user_id=42d37e4a8c4b40dbb293a9cdb56acb76)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.876585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.878345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 96/191] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:24.878345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.914654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.915495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.915780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.916056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.928416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:24.933929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:24.936228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:24.937210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 96/192] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:24.950507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.984112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:24.999325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd9dd1-0f19-40ca-8bd8-0b4cb25fe10d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.038426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.039249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.039534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.039810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.040976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.042475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.044106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 97/193] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:25.044868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.052918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e48bb-0244-419d-951a-f8dcb786fac0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.087157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.088246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.088529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.088811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.098925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:25.106986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:25.108073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 97/194] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:25.113777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.142458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710e414-3dd5-4268-8172-a088982dd926 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.158114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.175070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.175754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.176036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.176310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.203511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.208996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a676cd-157d-4f07-b4e9-df0f022d93f0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.242867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.243571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.243860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.244143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.245423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:25.245739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.247166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.247835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.249309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.255209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 98/195] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:25.259694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.347933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 98/196] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:25.348946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.351994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236a375-3428-4039-bf8e-47dfe62ed8d8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.367032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.385848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.386517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.386801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.387075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.387814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.389253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.446719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2ba88-5c91-4724-a790-602191f2afde None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.479631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.480282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.480563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.480834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.481585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:25.481886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.483332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.490836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 99/197] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:25.491660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.495784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 99/198] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:25 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:25.496792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.529315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.588117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.612686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32578d85-395a-44c5-9a04-29fd0f0102f0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.631816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ee41a-9dd1-45ee-84c0-76edae000c56 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.648288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.649191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.649474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.649752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] PATH_INFO: `/v3/users/9a5b901c1b7e45f8a6850fa7f2042b45` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.651068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] RBAC: Authorizing `identity:get_user(user_id=9a5b901c1b7e45f8a6850fa7f2042b45)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.652580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.654615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 100/199] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/users/9a5b901c1b7e45f8a6850fa7f2042b45 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:25.655203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.679868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.680750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.681034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.681309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.683329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.684856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.686750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 100/200] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:25.691438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.780033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a062975-8e7f-49a2-9c63-c831d41a87a0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.805135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.826704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.828774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.828774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.828774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] PATH_INFO: `/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.829322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a84f-4470-439e-897a-b25bf5a2cd0f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.831008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] RBAC: Authorizing `identity:get_user(user_id=42d37e4a8c4b40dbb293a9cdb56acb76)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.832512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.834333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 101/201] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:25.836684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:25.854554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:25.874966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.875691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.875974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.876244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.949525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d73b1-daa6-43bb-9e60-4034615721c6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:25.953920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.955602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.987824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:25.988487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:25.988768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:25.989043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:25.989889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=42d37e4a8c4b40dbb293a9cdb56acb76) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:25.990200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:25.992925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:25.998505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 102/202] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/role_assignments?user.id=42d37e4a8c4b40dbb293a9cdb56acb76&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:26.003505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:26.067500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:26.108930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 101/203] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:26.112488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:26.179626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:26.232397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47cca1-0d4c-4934-b6fb-50b3b0859c11 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:26.278426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12fb4-93a3-45d8-b622-5175046742de None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:26.315854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:26.316526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:26.316817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:26.317103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:26.337163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:26.338088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:26.338918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:26.339225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:26.341945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:26.343433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:26.346706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 102/204] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:26 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:26.351214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:26.439334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:26.440737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:26.442889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:26.524997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501755ed-31fc-4523-81f9-23d2398e5aa6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:26.561651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:26.562343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:26.562632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:26.562910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:26.563792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] RBAC: Adding query filter params (role.id=d3131ec4431541ca89f6192831c24667, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c, user.id=9a5b901c1b7e45f8a6850fa7f2042b45) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:26.564109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:26.565568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:26.571272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:26.571891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 103/205] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:26 2022] GET /identity/v3/role_assignments?user.id=9a5b901c1b7e45f8a6850fa7f2042b45&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=d3131ec4431541ca89f6192831c24667 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:26.622911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 103/206] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:26.629065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:26.792700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b9c0-5f70-4923-938a-7f4363076c77 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:26.812696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:26.833473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8735b9-ff69-43f0-9814-5019f4521b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:26.834345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8735b9-ff69-43f0-9814-5019f4521b49 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:26.834630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8735b9-ff69-43f0-9814-5019f4521b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:26.834907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8735b9-ff69-43f0-9814-5019f4521b49 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:26.836196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8735b9-ff69-43f0-9814-5019f4521b49 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:26.837669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8735b9-ff69-43f0-9814-5019f4521b49 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:26.840329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 104/207] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:26 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:26.846002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:26.980843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59ee7-9720-403d-b2d3-fcc7e69b42b1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:27.018831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:27.019549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:27.019830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:27.020102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:27.020942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] RBAC: Adding query filter params (role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=42d37e4a8c4b40dbb293a9cdb56acb76) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:27.021250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:27.022698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533303f-35e1-42d7-ad58-0864e3c89209 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:27.029565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 104/208] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:26 2022] GET /identity/v3/role_assignments?user.id=42d37e4a8c4b40dbb293a9cdb56acb76&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=825ed394374246a6a9348bca22ceafae => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:28.003488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079cda9-01ba-447e-ba5e-f9d0832fbf96 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.004011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079cda9-01ba-447e-ba5e-f9d0832fbf96 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.004357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079cda9-01ba-447e-ba5e-f9d0832fbf96 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.005874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 105/209] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:28.011347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.011759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.011902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.029422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:28.030622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:28.066529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:28.080413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8162-a32f-48d2-b65b-6db26b77a17b None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.080849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8162-a32f-48d2-b65b-6db26b77a17b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.081254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8162-a32f-48d2-b65b-6db26b77a17b None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.082702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 106/210] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:28.088405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.088791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.089150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.108421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:28.109728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:28.111448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 105/211] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:28.130268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.182445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 107/212] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:28.210620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.242163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b54169-51ed-4d4e-b6a5-3c2777f44081 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.279026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.279861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.280225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.280577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.281848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:28.283394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:28.285273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 106/213] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:28.290693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.321412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f019d7-3f0f-4702-88f4-07cbaa198a58 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.341289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:28.351479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:28.363781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.364827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.365291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.365739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.377248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:28.386086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:28.386935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:28.387740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:28.390402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 108/214] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:28.396654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.411582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde0ca-9f6d-485e-8a7c-6b547985bc1b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.454204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70b604-8cb3-46d9-a502-f08add4850f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.454993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70b604-8cb3-46d9-a502-f08add4850f5 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.455304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70b604-8cb3-46d9-a502-f08add4850f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.455578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70b604-8cb3-46d9-a502-f08add4850f5 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.456674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70b604-8cb3-46d9-a502-f08add4850f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:28.458381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70b604-8cb3-46d9-a502-f08add4850f5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:28.514920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def207d3-b6e9-483a-bfca-588880dc4447 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.551281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 107/215] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:28 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:28.551449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.551563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.551855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.552123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.552931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:28.553333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:28.554655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:28.558292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5b28f-f912-4b9c-a781-878e6b886f1c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.564996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5b28f-f912-4b9c-a781-878e6b886f1c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.564996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5b28f-f912-4b9c-a781-878e6b886f1c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.564996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 108/216] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:28.567004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.567504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 109/217] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:28.567775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.568073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.575138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.591204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:28.592638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:28.623499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:28.686455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 109/218] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:28.716339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c66d9-a469-4b2e-b162-547caef0967e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.726275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.757364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.758638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.759180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.759690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] PATH_INFO: `/v3/users/a85adbf0bf544aab99b23ec2e70194c4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.760000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:28.774821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] RBAC: Authorizing `identity:get_user(user_id=a85adbf0bf544aab99b23ec2e70194c4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:28.777063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:28.779074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 110/219] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/users/a85adbf0bf544aab99b23ec2e70194c4 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:28.784441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.852739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561ff68-6f45-4343-b5cb-e5c0fa52b770 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.894997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.895882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.896170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.896446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:28.909404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:28.913703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:28.919933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:28.921010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:28.921982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:28.923237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 110/220] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:28.927190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:28.927597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e448e9-d352-462f-994f-b56eeeeb8b87 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:28.978164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:28.979590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:28.979990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:28.980375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.038253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:29.053561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670255-2f2a-4934-873a-6cbdca1134ea None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.076308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.078242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.101462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.102146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.102442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.102731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.105609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:29.105883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.107346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.116633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 111/221] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:29.122607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:29.230505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:29.247472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 111/222] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:22:29.253013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:29.313531 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d359-b9ba-41c4-b4be-631cbda85dfc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.379903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beaf7f-b465-4e5e-81ba-3bfba989fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.380708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beaf7f-b465-4e5e-81ba-3bfba989fc09 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.380991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beaf7f-b465-4e5e-81ba-3bfba989fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.381267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beaf7f-b465-4e5e-81ba-3bfba989fc09 None admin] PATH_INFO: `/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.383637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beaf7f-b465-4e5e-81ba-3bfba989fc09 None admin] RBAC: Authorizing `identity:get_user(user_id=42d37e4a8c4b40dbb293a9cdb56acb76)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.385625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beaf7f-b465-4e5e-81ba-3bfba989fc09 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.387553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 112/223] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:29 2022] GET /identity/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:29.388738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733fe0d-f8fb-4a5e-bae3-96f38d4f46b1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.389947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733fe0d-f8fb-4a5e-bae3-96f38d4f46b1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.389947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733fe0d-f8fb-4a5e-bae3-96f38d4f46b1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.390649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 113/224] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:29.395885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.396175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.396454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.410306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1d70-ee3e-4f8e-966d-a499616359ab None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.414736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:29.415995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:29.431482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:29.453935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.455083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.455603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.456083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.457524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.459727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.462387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 112/225] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:29 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:29.464108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:29.499475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 114/226] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:29.500859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:29.550705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:29.585706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff1587-e61f-4731-8fca-7b2e087998fd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.623039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.624204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.624489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.624860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.626156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.627845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.629556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 113/227] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:29 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:29.630963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0fd80-e2ed-4b64-b793-d39e694da797 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.634047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:29.673908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.674569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.674855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.675180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.676024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=a85adbf0bf544aab99b23ec2e70194c4) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:29.676336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.677849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.687217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 115/228] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:29 2022] GET /identity/v3/role_assignments?user.id=a85adbf0bf544aab99b23ec2e70194c4&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:29.687217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:29.757033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:29.860571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530108-1e26-4254-b04c-2708722bb0a8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.895672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:29.919186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.920009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.920295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.920572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.932487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108ce23-d5cd-4aec-86b4-e9b8a408cf03 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:29.952031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:29.971867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:29.972789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:29.973560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 114/229] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:29.976423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:29.977555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:29.977980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:29.978392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783/users/42d37e4a8c4b40dbb293a9cdb56acb76/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:29.981770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] RBAC: Authorizing `identity:create_grant(project_id=191ff05bad484604bbc8843b92185783, user_id=42d37e4a8c4b40dbb293a9cdb56acb76, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:29.983547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:29.985770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:30.075508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 116/230] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:29 2022] PUT /identity/v3/projects/191ff05bad484604bbc8843b92185783/users/42d37e4a8c4b40dbb293a9cdb56acb76/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:30.095690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef9521-5224-4ed7-8e85-4e579601212b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:30.136257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:30.137243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:30.137729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:30.138146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:30.139154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:30.139618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:30.141291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:30.157457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 115/231] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:30.163157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:30.297678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:30.340530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a210-2d24-4ad9-802d-f70bb6ab72ab None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:30.378110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:30.379413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:30.379898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:30.380372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] PATH_INFO: `/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:30.381865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] RBAC: Authorizing `identity:get_user(user_id=42d37e4a8c4b40dbb293a9cdb56acb76)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:30.383546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:30.385923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 117/232] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:30 2022] GET /identity/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:30.395145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:30.478286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:30.544475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397692b4-1a5d-4168-b363-77c4bf060fe6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:30.590959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feb730-1d18-4cb0-b3d7-3812670a338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:30.592197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feb730-1d18-4cb0-b3d7-3812670a338e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:30.592704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feb730-1d18-4cb0-b3d7-3812670a338e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:30.593234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feb730-1d18-4cb0-b3d7-3812670a338e None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:30.594676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97feb730-1d18-4cb0-b3d7-3812670a338e None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:30.596380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97feb730-1d18-4cb0-b3d7-3812670a338e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:30.598302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 116/233] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:30 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:30.605020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:30.739318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9e123-0cbd-4896-b278-7edeff77cabc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:30.783628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17638-28b5-4a25-9043-9a17dd6e39eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:30.784950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17638-28b5-4a25-9043-9a17dd6e39eb None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:30.785460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17638-28b5-4a25-9043-9a17dd6e39eb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:30.785932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17638-28b5-4a25-9043-9a17dd6e39eb None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783/users/42d37e4a8c4b40dbb293a9cdb56acb76/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:30.788547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17638-28b5-4a25-9043-9a17dd6e39eb None admin] RBAC: Authorizing `identity:create_grant(project_id=191ff05bad484604bbc8843b92185783, user_id=42d37e4a8c4b40dbb293a9cdb56acb76, role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:30.790281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17638-28b5-4a25-9043-9a17dd6e39eb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:30.885252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:30.890741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 118/234] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:30 2022] PUT /identity/v3/projects/191ff05bad484604bbc8843b92185783/users/42d37e4a8c4b40dbb293a9cdb56acb76/roles/825ed394374246a6a9348bca22ceafae => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:31.381778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7e39-67ab-4864-bb2a-ab73e3487525 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.382788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7e39-67ab-4864-bb2a-ab73e3487525 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.383321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7e39-67ab-4864-bb2a-ab73e3487525 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.385519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 117/235] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:31.391508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.393677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.394160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.410259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d081-5538-4bf8-bce3-5f38dc41477c None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.410572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d081-5538-4bf8-bce3-5f38dc41477c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.410832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d081-5538-4bf8-bce3-5f38dc41477c None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.412257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 118/236] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:31.419159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.419452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.419733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.421857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:31.423067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:31.450693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:31.451934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:31.541521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 119/237] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:31.565963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:31.567418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 119/238] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:31.608402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:31.615714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:31.668990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b736-e59a-4e3b-b7c8-d23f9b0d4646 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:31.727752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:31.729127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.729418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.729699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.735128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:31.736646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:31.738350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 120/239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:31.747022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:31.783323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416ca5-abf3-4b70-ab7e-91cc59b2654a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:31.815547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:31.829601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:31.830408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.830693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.830973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.853159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:31.861502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:31.862363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:31.863178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:31.876381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 120/240] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:31.877249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:31.924847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf0ee-f897-410c-a47c-c2621b8e1a0a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:31.941741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:31.966375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:31.967069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:31.967387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:31.967668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:31.968419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:31.969880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:32.020135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7f07e-f962-49a9-b585-dbc41b20408b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:32.060341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:32.061021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.061309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.061589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.062361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:32.062672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:32.064146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:32.080717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 121/241] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:31 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:32.080880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 121/242] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:32.088911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:32.209106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf19ab-a8b6-4005-93fb-9a66fa143d75 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:32.264906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fe65-a91a-436d-8ca3-f7fb6eaf27e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:32.265872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fe65-a91a-436d-8ca3-f7fb6eaf27e3 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.266168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fe65-a91a-436d-8ca3-f7fb6eaf27e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.266453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fe65-a91a-436d-8ca3-f7fb6eaf27e3 None admin] PATH_INFO: `/v3/users/7c569ecb282947618c6d01a0ccb9f7a4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.289663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621fe65-a91a-436d-8ca3-f7fb6eaf27e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7c569ecb282947618c6d01a0ccb9f7a4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:32.291306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621fe65-a91a-436d-8ca3-f7fb6eaf27e3 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:32.293224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 122/243] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:32 2022] GET /identity/v3/users/7c569ecb282947618c6d01a0ccb9f7a4 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:32.299135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:32.361387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:32.433390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe21e2-92ce-40fb-b726-208c998b9662 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:32.470185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:32.470865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.471183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.471465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.544598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:32.546086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:32.577724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04ed75-0086-463f-958e-0e91b980dbd6 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.578307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04ed75-0086-463f-958e-0e91b980dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.578307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04ed75-0086-463f-958e-0e91b980dbd6 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.579965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 123/244] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:32.587821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.588416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.588880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.612922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:32.614520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:32.634028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:32.656799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:32.677323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 122/245] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:32.683042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:32.717743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 124/246] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:32.748251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:32.793614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02917c-f8e9-40e3-ab67-efb896f1b507 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:32.830939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e897-38f7-449b-8290-27cd9af32238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:32.832315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e897-38f7-449b-8290-27cd9af32238 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.832315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e897-38f7-449b-8290-27cd9af32238 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.832691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e897-38f7-449b-8290-27cd9af32238 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.834019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e897-38f7-449b-8290-27cd9af32238 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:32.835638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e897-38f7-449b-8290-27cd9af32238 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:32.838009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 123/247] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:32 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:32.845677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa021-b16f-476e-95ad-c20f208e50b6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.846217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa021-b16f-476e-95ad-c20f208e50b6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.847759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa021-b16f-476e-95ad-c20f208e50b6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.849079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 124/248] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:32.851947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa021-b16f-476e-95ad-c20f208e50b6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:32.874086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:32.878495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699f9d3-308e-4693-a568-c92cc27db935 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:32.925850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf16e27-2ce3-4da1-882f-9171ac67d861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:32.926670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16e27-2ce3-4da1-882f-9171ac67d861 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.927123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16e27-2ce3-4da1-882f-9171ac67d861 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.927420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf16e27-2ce3-4da1-882f-9171ac67d861 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.941307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf16e27-2ce3-4da1-882f-9171ac67d861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7bf16e27-2ce3-4da1-882f-9171ac67d861 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:32.949220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:32.950220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:32.951029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 125/249] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:32.951720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:32.951982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:32.952259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:32.977408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:32.979184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:32.983335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa021-b16f-476e-95ad-c20f208e50b6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.002061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:33.024327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.025514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.026341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.026939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.028209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] RBAC: Adding query filter params (role.id=d3131ec4431541ca89f6192831c24667, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=7c569ecb282947618c6d01a0ccb9f7a4) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:33.029038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:33.030994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:33.038200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 125/250] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:32 2022] GET /identity/v3/role_assignments?user.id=7c569ecb282947618c6d01a0ccb9f7a4&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=d3131ec4431541ca89f6192831c24667 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:33.039426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.148012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 126/251] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:33.171491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:33.193789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.207088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa169-5739-4743-afa9-7eebe4d34e32 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.276046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.276738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.277193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.277646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:33.279050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:33.280665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:33.296424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 126/252] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:33.302392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.360919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a161a-4676-4e8a-85f6-7f772801598e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.426632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.427702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.428121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.428561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.441292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:33.450721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:33.451825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:33.452721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:33.454716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 127/253] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:33.464728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.483018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:33.513307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b862-17d6-4292-8b60-e2e8ec4781b5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.596325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.597325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.597619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.597897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] PATH_INFO: `/v3/users/a85adbf0bf544aab99b23ec2e70194c4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.603612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] RBAC: Authorizing `identity:get_user(user_id=a85adbf0bf544aab99b23ec2e70194c4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:33.605372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:33.607558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 127/254] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/users/a85adbf0bf544aab99b23ec2e70194c4 => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:33.609760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487855c-6b86-456e-b996-d19b3934ee02 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.613409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.643078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:33.646841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.647651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.647943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.648273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.649044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:33.649348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:33.651044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:33.660288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 128/255] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:33.666517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.744021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:33.775687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2017a-d332-4f87-a347-d9a2d8cf7916 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.811912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.812799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.813082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.813361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] PATH_INFO: `/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.814623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] RBAC: Authorizing `identity:get_user(user_id=42d37e4a8c4b40dbb293a9cdb56acb76)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:33.816137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:33.818096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 129/256] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:33.822307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb9a1-b4a8-4337-9746-5ae2414f5b76 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:33.823576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.881983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:33.882852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:33.883159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:33.883439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:33.884660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:33.886113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:33.888184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 128/257] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:33.894302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:33.982585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d18a-85e5-40ab-bc53-adc2afba8231 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:34.048744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:34.051512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:34.052177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.052459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.052732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.079568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:34.095580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29328962-91a2-46fb-9b76-8d40b876c230 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:34.163771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320d253-d99c-4971-be61-cac83871e57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:34.164831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320d253-d99c-4971-be61-cac83871e57c None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.165109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320d253-d99c-4971-be61-cac83871e57c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.165381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320d253-d99c-4971-be61-cac83871e57c None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783/users/a85adbf0bf544aab99b23ec2e70194c4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.168397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320d253-d99c-4971-be61-cac83871e57c None admin] RBAC: Authorizing `identity:create_grant(project_id=191ff05bad484604bbc8843b92185783, user_id=a85adbf0bf544aab99b23ec2e70194c4, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:34.169847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320d253-d99c-4971-be61-cac83871e57c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:34.171022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:34.172531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:34.249910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 129/258] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:33 2022] PUT /identity/v3/projects/191ff05bad484604bbc8843b92185783/users/a85adbf0bf544aab99b23ec2e70194c4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:34.251463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1426-d33e-48d6-878c-506385cb68b3 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.251752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1426-d33e-48d6-878c-506385cb68b3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.252157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1426-d33e-48d6-878c-506385cb68b3 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.254795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 130/259] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:34.261362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.261659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.261927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.295582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:34.297518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:34.346501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 130/260] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:34.352272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:34.430204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:34.437156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 131/261] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:34.464121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:34.564137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6349493-4d5f-4d9f-a72d-de4561c2ea05 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:34.580236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:34.620653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9b687-0ab4-4c6b-85c1-7f520fbf3465 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:34.635455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:34.636423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.636627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.637046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.638070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:34.639552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:34.641344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 131/262] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:34 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:34.652918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:34.678249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:34.679064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.679416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.679691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.690206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:34.698933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:34.699828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:34.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 132/263] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:34.706247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:34.887061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a888f8-54c7-4384-92a0-ae215684a33d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:34.896575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:34.906221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f10749-1372-4ffe-8df2-94d14076fe3f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:34.922135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:34.922804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.923087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.923403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.924252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=42d37e4a8c4b40dbb293a9cdb56acb76) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:34.924563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:34.926012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:34.933288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 132/264] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:34 2022] GET /identity/v3/role_assignments?user.id=42d37e4a8c4b40dbb293a9cdb56acb76&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:34.959485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:34.971597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:34.972386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:34.972679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:34.976486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:34.976486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:34.976486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:34.976486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:34.991639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 133/265] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:35.000403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:35.132868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0782b-2bcf-41c8-b719-a38b57d4b40a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:35.169426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:35.170293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:35.170579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:35.170854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] PATH_INFO: `/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:35.172161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=42d37e4a8c4b40dbb293a9cdb56acb76)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:35.173655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:35.175723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 133/266] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:34 2022] GET /identity/v3/users/42d37e4a8c4b40dbb293a9cdb56acb76 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:35.181390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:35.313958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc2087-1e95-40d6-80d8-1e32b73871ef None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:35.359765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62344d10-cf29-4e5b-8589-b4f6f05a5e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:35.360465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344d10-cf29-4e5b-8589-b4f6f05a5e59 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:35.360755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344d10-cf29-4e5b-8589-b4f6f05a5e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:35.361031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344d10-cf29-4e5b-8589-b4f6f05a5e59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:35.430692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:35.440043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62344d10-cf29-4e5b-8589-b4f6f05a5e59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:35.441519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62344d10-cf29-4e5b-8589-b4f6f05a5e59 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:35.547212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 134/267] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:35.552804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:35.597898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:35.622105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a130b-77a9-4e2d-953d-21c7e45ce88d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:35.622608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a130b-77a9-4e2d-953d-21c7e45ce88d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:35.622682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a130b-77a9-4e2d-953d-21c7e45ce88d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:35.624335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 135/268] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:35.631814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:35.632100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:35.632378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:35.659947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:35.661511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:35.683449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724862-fd7a-4141-bab1-d69a4c02eeb6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:35.731586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:35.733493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:35.733965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:35.734664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:35.736374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:35.738431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:35.741240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 134/269] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:35 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:35.748034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:35.779123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 136/270] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:35.797182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:35.832874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:35.938687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f9b2a-7e65-4c6a-a0fd-9d3f4e464068 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:35.953948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:35.990664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9bab-1c75-412b-a591-4bd4d457a07f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.026859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.027595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.027884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.028164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.029009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] RBAC: Adding query filter params (role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=42d37e4a8c4b40dbb293a9cdb56acb76) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:36.029325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:36.030782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feb387-b7ec-450d-babc-c27cfe49d76a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:36.036575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.037371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.037652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.037929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.039273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:36.040726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:36.043276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 137/271] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:36.047133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 135/272] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:35 2022] GET /identity/v3/role_assignments?user.id=42d37e4a8c4b40dbb293a9cdb56acb76&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=825ed394374246a6a9348bca22ceafae => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:36.052344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.068529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983bd9-9bcd-4359-aced-bb467dc3a759 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.068816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983bd9-9bcd-4359-aced-bb467dc3a759 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.069096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983bd9-9bcd-4359-aced-bb467dc3a759 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.070504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 136/273] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:36.079342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6462d-c258-495e-9799-dbcf4cf4e546 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.079623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6462d-c258-495e-9799-dbcf4cf4e546 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.079907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6462d-c258-495e-9799-dbcf4cf4e546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.112320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-58f6462d-c258-495e-9799-dbcf4cf4e546 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:36.113563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-58f6462d-c258-495e-9799-dbcf4cf4e546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:36.226912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:36.242604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95a2f6-67cf-4ac5-87d7-3e289e2b3b38 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.250554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 137/274] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:36.252431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccb300-d0da-4a51-8ed5-a1cc00615537 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.252926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccb300-d0da-4a51-8ed5-a1cc00615537 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.253405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccb300-d0da-4a51-8ed5-a1cc00615537 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.255397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 138/275] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:36.262945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.263365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.263536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.289389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:36.290559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:36.292577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.293443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.293880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.294164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.294971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:36.296516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:36.368917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 139/276] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:36.370299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.385681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 138/277] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:22:36 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:22:36.399330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.411394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:36.506901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c516c3-1709-4b81-81eb-37d91b4006cd None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.552428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887d038-c195-463e-9306-480c1d019974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.553297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887d038-c195-463e-9306-480c1d019974 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.553582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887d038-c195-463e-9306-480c1d019974 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.553935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887d038-c195-463e-9306-480c1d019974 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.556660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596582d-b90b-4e28-8366-82dbf1c21a47 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.565784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887d038-c195-463e-9306-480c1d019974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-4887d038-c195-463e-9306-480c1d019974 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:36.574157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:36.575154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:36.576049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 140/278] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:36.582874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887d038-c195-463e-9306-480c1d019974 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.613482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.614765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.615059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.615516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.628939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:36.638593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:36.639525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:36.640299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:36.643174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 139/279] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:36.646052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.658220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:36.713926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:36.722671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887d038-c195-463e-9306-480c1d019974 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.785811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.785811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.785811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.785811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.786183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:36.786183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:36.786183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:36.786366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8662-1def-4a2b-bb09-bbb8e1aedd4b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.786435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 141/280] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:36.789739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.835248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.835972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.836256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.837162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.838510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:36.838510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:36.840611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:36.851720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 140/281] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:36.857624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:36.910574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f77b3-d1d9-4efa-9f3a-9ff245d0d901 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:36.959454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:36.970898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:36.971869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:36.972159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:36.972438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] PATH_INFO: `/v3/users/7c569ecb282947618c6d01a0ccb9f7a4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:36.973724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] RBAC: Authorizing `identity:get_user(user_id=7c569ecb282947618c6d01a0ccb9f7a4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:36.975484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:36.980112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 142/282] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/users/7c569ecb282947618c6d01a0ccb9f7a4 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:36.986413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:37.029323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868bd09-b8e8-4bde-a50b-716544fc6b8e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:37.035421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:37.094991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:37.095823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.096104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.096378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] PATH_INFO: `/v3/users/b9ebc747e3194683b03c8761e8510e35` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.132503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] RBAC: Authorizing `identity:get_user(user_id=b9ebc747e3194683b03c8761e8510e35)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:37.134003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:37.136737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 141/283] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/users/b9ebc747e3194683b03c8761e8510e35 => generated 293 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:37.151149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:37.203057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f733c2-26d9-4f19-9949-c3930073646e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:37.265531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:37.266409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.266697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.266976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.276655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:37.278115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:37.279999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 143/284] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:36 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:37.286239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:37.312792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ef3b-0316-4033-9fc5-ea854a5a7b83 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:37.363140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:37.372081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:37.372738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.373022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.373297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.374126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, user.id=b9ebc747e3194683b03c8761e8510e35, scope.system=all) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:37.374437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:37.375909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164f65f-07ff-4756-8a50-58433cf08098 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:37.387572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 142/285] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 23 15:22:37 2022] GET /identity/v3/role_assignments?user.id=b9ebc747e3194683b03c8761e8510e35&scope.system=all&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:37.389063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5bed8-3c3b-4954-b645-382b974c948e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.389357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5bed8-3c3b-4954-b645-382b974c948e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.389633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5bed8-3c3b-4954-b645-382b974c948e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.391064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 143/286] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:37.417195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.417565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.417779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.425737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:37.437554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843da88-70cd-4205-b315-be07431cd023 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:37.464234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:37.465522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:37.489901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:37.491837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.492347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.493183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783/users/7c569ecb282947618c6d01a0ccb9f7a4/roles/d3131ec4431541ca89f6192831c24667` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.496435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] RBAC: Authorizing `identity:create_grant(project_id=191ff05bad484604bbc8843b92185783, user_id=7c569ecb282947618c6d01a0ccb9f7a4, role_id=d3131ec4431541ca89f6192831c24667)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:37.498610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:37.571008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 144/287] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:37.590695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 144/288] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:22:37 2022] PUT /identity/v3/projects/191ff05bad484604bbc8843b92185783/users/7c569ecb282947618c6d01a0ccb9f7a4/roles/d3131ec4431541ca89f6192831c24667 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:22:37.593813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:37.723502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2abf3-349c-4622-87e3-cd0df7bb10d2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:37.749578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:37.769344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:37.770176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.770456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.770731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.792121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:37.800229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:37.801173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:37.801936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 145/289] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:37.808082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:37.941147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb9f8-960f-4e89-a9ff-0fe0ace10d66 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:37.983004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:37.984139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:37.984653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:37.985124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:37.986098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:37.986621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:37.988238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:37.998542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 145/290] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:38.003966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:38.141872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ba1de-cab4-41c6-837f-fcbac227e6d4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:38.177154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:38.178024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:38.178296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:38.178575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] PATH_INFO: `/v3/users/a85adbf0bf544aab99b23ec2e70194c4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:38.183832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] RBAC: Authorizing `identity:get_user(user_id=a85adbf0bf544aab99b23ec2e70194c4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:38.185301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:38.187282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 146/291] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:38 2022] GET /identity/v3/users/a85adbf0bf544aab99b23ec2e70194c4 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:38.192575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:38.224390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:38.330500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284cb7-c833-4497-8947-ffb01846d02f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:38.369398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:38.370057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:38.370339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:38.370621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:38.463536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:38.465127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:38.486628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:38.599197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 146/292] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:38.605002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:38.727815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:38.847933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad93e9d-d931-4a0e-b423-d525d1cbc822 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:38.913676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880e60a-35a0-4757-a959-02ae1e9889d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:38.915603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880e60a-35a0-4757-a959-02ae1e9889d3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:38.916903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880e60a-35a0-4757-a959-02ae1e9889d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:38.917654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880e60a-35a0-4757-a959-02ae1e9889d3 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:38.919908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880e60a-35a0-4757-a959-02ae1e9889d3 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:38.922853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880e60a-35a0-4757-a959-02ae1e9889d3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:38.932185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 147/293] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:38 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:38.938267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:39.150742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b654e-d536-460e-9a4a-41d31e23fdbd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:39.189612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:39.233208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:39.233208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.233647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.234044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.236052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=a85adbf0bf544aab99b23ec2e70194c4) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:39.236052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:39.238362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5d61e-a994-42d3-8ed9-19162348e48c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:39.258807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 147/294] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:38 2022] GET /identity/v3/role_assignments?user.id=a85adbf0bf544aab99b23ec2e70194c4&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:39.540622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2408be-60d8-4a91-b079-9091ded0c72f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.541541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2408be-60d8-4a91-b079-9091ded0c72f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.541788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2408be-60d8-4a91-b079-9091ded0c72f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.543623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 148/295] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:39.549116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.549414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.549700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.562850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ae87-5f99-40cd-a44c-f0dfc2697afb None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.563208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ae87-5f99-40cd-a44c-f0dfc2697afb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.563445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ae87-5f99-40cd-a44c-f0dfc2697afb None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.565266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 149/296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:39.570542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:39.570860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.571180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.571458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.571800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:39.589248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:39.590432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:39.672881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 148/297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:39.691202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 150/298] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:39.695188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:39.715179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:39.770164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:39.818717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54feed-eaa2-4d03-addb-584c1ee1a6f0 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:39.829432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:39.842791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aef16a-f9bc-4789-9265-abecdf54697d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:39.863614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:39.864422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.864706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.864982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.866158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:39.867725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:39.869463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 149/299] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:39.875547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:39.890038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:39.891250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:39.891677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:39.892091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:39.910833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:39.920797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:39.922986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:39.925236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 151/300] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:39.931183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.005109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8457e6d-be91-4405-8edd-08ee624189f2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.043161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.043948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.044233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.044507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] PATH_INFO: `/v3/groups` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.045200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:40.046823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:40.049740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157d2f-57a5-4617-b8b8-f0c5059c84f5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.057657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:40.085693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.086293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.086574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.086846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.087787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:40.093264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:40.093264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:40.102397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 152/301] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:40.103431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.123793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 150/302] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 23 15:22:39 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:40.219121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec243b3-b63f-46ae-9fd7-39631f64e48f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.259253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3257b0-6c01-4716-8f31-d8c7272210c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.260741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3257b0-6c01-4716-8f31-d8c7272210c8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.261018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3257b0-6c01-4716-8f31-d8c7272210c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.261290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3257b0-6c01-4716-8f31-d8c7272210c8 None admin] PATH_INFO: `/v3/users/84671ef3afb7441d8044578bb3d511f7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.278546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3257b0-6c01-4716-8f31-d8c7272210c8 None admin] RBAC: Authorizing `identity:get_user(user_id=84671ef3afb7441d8044578bb3d511f7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:40.280094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3257b0-6c01-4716-8f31-d8c7272210c8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:40.282323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 153/303] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/users/84671ef3afb7441d8044578bb3d511f7 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:40.287943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.333446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:40.355144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de999ebc-ede3-4a59-b3ef-b60ea2204cfc None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.355414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de999ebc-ede3-4a59-b3ef-b60ea2204cfc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.355669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de999ebc-ede3-4a59-b3ef-b60ea2204cfc None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.357291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 154/304] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:40.362384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.362678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.362955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.382190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:40.383077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:40.407197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:40.409388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df04f3-5161-46ea-b99f-a8449e7cce05 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.453903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.454569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.454853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.455154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.455997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] RBAC: Adding query filter params (role.id=d3131ec4431541ca89f6192831c24667, user.id=84671ef3afb7441d8044578bb3d511f7, scope.system=all) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:40.456310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:40.457751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c72a07-5d3d-4b68-a623-6aae7bc9d55f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:40.463088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 151/305] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/role_assignments?user.id=84671ef3afb7441d8044578bb3d511f7&scope.system=all&role.id=d3131ec4431541ca89f6192831c24667 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:40.464189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8ff7-e980-4a9e-8d49-dddeb90749f1 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.464476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8ff7-e980-4a9e-8d49-dddeb90749f1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.464754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8ff7-e980-4a9e-8d49-dddeb90749f1 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.466087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 152/306] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:40.472892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 155/307] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:40.476668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.476962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.477246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.496075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:40.497449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:40.498574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.581218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 153/308] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:40.606060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.640668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:40.646364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f71a-2085-4370-9c43-cc9a9c995727 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.690447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.691378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.691728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.692066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.707688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:40.716446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:40.717319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:40.718253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 156/309] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:40.724490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.736792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b7ac7-861d-474f-8fd5-586611a286be None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.745339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:40.785093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.786162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.787116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.787571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.802817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:40.813601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:40.814710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:40.815714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:40.818711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 154/310] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:40.825004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.849919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca4c5-3e0a-4371-879f-1241cd06fda3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.889794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.890437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.890785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.891176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.892056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:40.892529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:40.894320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:40.904230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 157/311] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:40.909702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:40.941819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:40.955264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724549b-8f45-4bb1-a4b1-c00564e62add None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:40.992171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:40.992956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:40.993304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:40.993645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:40.994997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:40.995435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:40.997056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.000849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:41.012437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 155/312] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:41.013479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:41.027296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ce0e6-e8d1-43de-8abd-e5cf14d197b9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:41.065590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c4419-8356-4910-93da-070c689bff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:41.066813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4419-8356-4910-93da-070c689bff8b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:41.067406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4419-8356-4910-93da-070c689bff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:41.068003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4419-8356-4910-93da-070c689bff8b None admin] PATH_INFO: `/v3/users/b9ebc747e3194683b03c8761e8510e35` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:41.069431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c4419-8356-4910-93da-070c689bff8b None admin] RBAC: Authorizing `identity:get_user(user_id=b9ebc747e3194683b03c8761e8510e35)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:41.071250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c4419-8356-4910-93da-070c689bff8b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.078606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 158/313] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:40 2022] GET /identity/v3/users/b9ebc747e3194683b03c8761e8510e35 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:41.079695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c4419-8356-4910-93da-070c689bff8b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:41.121452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424d689-8d46-4079-8efb-ae59bb531289 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:41.156628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:41.157480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:41.157778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:41.158029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] PATH_INFO: `/v3/users/7c569ecb282947618c6d01a0ccb9f7a4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:41.159798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] RBAC: Authorizing `identity:get_user(user_id=7c569ecb282947618c6d01a0ccb9f7a4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:41.160849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.162659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 156/314] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:41 2022] GET /identity/v3/users/7c569ecb282947618c6d01a0ccb9f7a4 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:41.168721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:41.189552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:41.195458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c4419-8356-4910-93da-070c689bff8b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:41.232888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:41.234123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:41.234615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:41.235141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] PATH_INFO: `/v3/system/users/b9ebc747e3194683b03c8761e8510e35/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:41.236872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b9ebc747e3194683b03c8761e8510e35, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:41.239283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.286788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ce9a-8195-4524-8b15-af3a285f12c8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:41.325996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:41.326662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:41.326945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:41.327246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:41.341269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 159/315] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 23 15:22:41 2022] PUT /identity/v3/system/users/b9ebc747e3194683b03c8761e8510e35/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:41.414013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:41.416518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.438511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:41.542067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 157/316] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:22:41.547746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:41.561870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:41.657093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901d64e-9252-4293-b841-8fba588c47dc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:41.694019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ed59b-1b63-4aa8-b5c5-d772e68bdf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:41.695265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed59b-1b63-4aa8-b5c5-d772e68bdf6a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:41.695759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed59b-1b63-4aa8-b5c5-d772e68bdf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:41.696224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed59b-1b63-4aa8-b5c5-d772e68bdf6a None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:41.697728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ed59b-1b63-4aa8-b5c5-d772e68bdf6a None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:41.699493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ed59b-1b63-4aa8-b5c5-d772e68bdf6a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.701751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 160/317] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:41 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:41.707739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:41.829335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9152-1486-4b7f-9cd7-1e356fcb6683 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:41.847879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:41.865931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:41.866703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:41.866987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:41.867293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:41.868133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] RBAC: Adding query filter params (role.id=d3131ec4431541ca89f6192831c24667, scope.project.id=191ff05bad484604bbc8843b92185783, user.id=7c569ecb282947618c6d01a0ccb9f7a4) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:41.868445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:41.869891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ad6b-5675-4f41-9d04-c2e168bdd5fc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:41.876878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 158/318] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:22:41 2022] GET /identity/v3/role_assignments?user.id=7c569ecb282947618c6d01a0ccb9f7a4&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=d3131ec4431541ca89f6192831c24667 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:42.426886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7c99d-57f7-47f8-8344-d322c62b68cc None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:42.427492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7c99d-57f7-47f8-8344-d322c62b68cc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:42.427492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7c99d-57f7-47f8-8344-d322c62b68cc None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:42.428959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 161/319] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:42.434649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:42.435065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:42.435310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:42.453750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:42.454927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:42.525055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 159/320] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:42.546785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7c99d-57f7-47f8-8344-d322c62b68cc None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:42.691977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:42.715176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7c99d-57f7-47f8-8344-d322c62b68cc None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:42.749864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e715361-5727-43ef-96a5-edd17c01f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:42.750663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715361-5727-43ef-96a5-edd17c01f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:42.750948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715361-5727-43ef-96a5-edd17c01f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:42.751255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715361-5727-43ef-96a5-edd17c01f5dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:42.752412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715361-5727-43ef-96a5-edd17c01f5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:42.753881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715361-5727-43ef-96a5-edd17c01f5dc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:42.755690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 162/321] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:22:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:42.762183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:42.763187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206b6d9-0170-4519-8944-1dd0d016e980 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:42.763481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206b6d9-0170-4519-8944-1dd0d016e980 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:42.763763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206b6d9-0170-4519-8944-1dd0d016e980 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:42.765198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 163/322] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:42.769959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:42.770253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:42.770537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:42.787231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:42.788347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:42.860011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 164/323] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:42.874661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0db5-03d2-4efa-9d1e-1af8623fe3ac None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:42.882187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:42.889402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:42.915566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:42.916506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:42.916797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:42.917107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] PATH_INFO: `/v3/groups` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:42.918670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:42.920144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:42.959483 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:42.982034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e133b9-9369-46f6-9701-a4e67827c026 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:43.009372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 160/324] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 23 15:22:42 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:22:43.017113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:43.017943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.018219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.018488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.031816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:43.039914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:43.040892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:43.041685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 165/325] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:43.048697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:43.161243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76fe5-9e6e-4aae-aeb5-7149f811bc8c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:43.201266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:43.202303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.202303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.202489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.203267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:43.203588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:43.204941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:43.213728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 161/326] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:43.219193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:43.333004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4369d-a8b8-4da8-b50d-6d51ef92b282 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:43.370116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b789fa-98f4-48cc-9827-b61332553491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:43.371084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b789fa-98f4-48cc-9827-b61332553491 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.371458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b789fa-98f4-48cc-9827-b61332553491 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.371797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b789fa-98f4-48cc-9827-b61332553491 None admin] PATH_INFO: `/v3/users/84671ef3afb7441d8044578bb3d511f7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.373078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b789fa-98f4-48cc-9827-b61332553491 None admin] RBAC: Authorizing `identity:get_user(user_id=84671ef3afb7441d8044578bb3d511f7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:43.374590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b789fa-98f4-48cc-9827-b61332553491 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:43.376724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 166/327] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:43 2022] GET /identity/v3/users/84671ef3afb7441d8044578bb3d511f7 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:43.382131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:43.420175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:43.495741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5db2-5d34-4e6b-929b-c231fd771327 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:43.534886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9853fe-fb34-44d0-bbbb-99e68485307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:43.535888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9853fe-fb34-44d0-bbbb-99e68485307c None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.536237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9853fe-fb34-44d0-bbbb-99e68485307c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.536581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9853fe-fb34-44d0-bbbb-99e68485307c None admin] PATH_INFO: `/v3/system/users/84671ef3afb7441d8044578bb3d511f7/roles/d3131ec4431541ca89f6192831c24667` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.538227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9853fe-fb34-44d0-bbbb-99e68485307c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=84671ef3afb7441d8044578bb3d511f7, role_id=d3131ec4431541ca89f6192831c24667)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:43.539698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9853fe-fb34-44d0-bbbb-99e68485307c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:43.613137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 162/328] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 23 15:22:43 2022] PUT /identity/v3/system/users/84671ef3afb7441d8044578bb3d511f7/roles/d3131ec4431541ca89f6192831c24667 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:43.644770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be22f-9021-46f1-b891-6703fd89a7ff None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.645274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be22f-9021-46f1-b891-6703fd89a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.645438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be22f-9021-46f1-b891-6703fd89a7ff None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.647172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 167/329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:43.652916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.653198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.653516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.675169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:43.676616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:43.757032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 163/330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:43.781531 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be22f-9021-46f1-b891-6703fd89a7ff None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:43.786922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:43.924151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be22f-9021-46f1-b891-6703fd89a7ff None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:43.961245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:43.962055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:43.962339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:43.963185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:43.983321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:43.991203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:43.992077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:43.992860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 168/331] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:43.999903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:44.042869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:44.139112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1ed0d-4f49-4070-8b57-0954fd326726 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:44.181326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:44.181947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:44.182233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:44.182511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:44.183303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:44.183617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:44.185010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:44.194275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 164/332] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:44.200672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:44.337778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:44.383662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527e63-11d1-4306-af18-1c751c165c20 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:44.422216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfabb08-713c-4bb2-8dcb-6d25cb7c8dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:44.423196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfabb08-713c-4bb2-8dcb-6d25cb7c8dbb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:44.423485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfabb08-713c-4bb2-8dcb-6d25cb7c8dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:44.423764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfabb08-713c-4bb2-8dcb-6d25cb7c8dbb None admin] PATH_INFO: `/v3/users/b9ebc747e3194683b03c8761e8510e35` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:44.424985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfabb08-713c-4bb2-8dcb-6d25cb7c8dbb None admin] RBAC: Authorizing `identity:get_user(user_id=b9ebc747e3194683b03c8761e8510e35)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:44.426514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfabb08-713c-4bb2-8dcb-6d25cb7c8dbb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:44.428197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 169/333] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:44 2022] GET /identity/v3/users/b9ebc747e3194683b03c8761e8510e35 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:44.434594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:44.554038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:44.563780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc0fd-64b6-414d-8a63-f5a23c6c8b91 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:44.607447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:44.608108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:44.608394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:44.608671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:44.609511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] RBAC: Adding query filter params (role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, user.id=b9ebc747e3194683b03c8761e8510e35, scope.system=all) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:44.609828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:44.611291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae88b5-e1aa-4616-9729-4ffdec69899b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:44.626370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 165/334] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 23 15:22:44 2022] GET /identity/v3/role_assignments?user.id=b9ebc747e3194683b03c8761e8510e35&scope.system=all&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:45.916984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3e9a4-ba7f-4636-ace4-75233f5c4aab None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:45.917491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3e9a4-ba7f-4636-ace4-75233f5c4aab None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:45.917566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3e9a4-ba7f-4636-ace4-75233f5c4aab None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:45.919256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 170/335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:45.924417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:45.924836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:45.925023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:45.948476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:45.949685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:46.024467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 166/336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:46.067206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3e9a4-ba7f-4636-ace4-75233f5c4aab None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:46.184302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3e9a4-ba7f-4636-ace4-75233f5c4aab None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:46.216304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:46.221293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8a81-4e1b-4019-a2bc-336618d535ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:46.222097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8a81-4e1b-4019-a2bc-336618d535ee None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.222384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8a81-4e1b-4019-a2bc-336618d535ee None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.222665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8a81-4e1b-4019-a2bc-336618d535ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.235290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc8a81-4e1b-4019-a2bc-336618d535ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c7fc8a81-4e1b-4019-a2bc-336618d535ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:46.242983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:46.243919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:46.244708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 171/337] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:46.252274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:46.279150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00668b4-b584-43c0-be27-8c06ee2fad12 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.279774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00668b4-b584-43c0-be27-8c06ee2fad12 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.280285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00668b4-b584-43c0-be27-8c06ee2fad12 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.282019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 172/338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:46.287778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.288334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.288808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.320814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:46.322087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:46.430585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:46.444104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 173/339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:46.472314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f2c3-ea62-4660-832a-3a10c1d90fb4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:46.483336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:46.518456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:46.523182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.523517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.523811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.524605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:46.524925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:46.529220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:46.544299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 167/340] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:46.549923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:46.677276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1131175-cd54-493c-bfde-aff9d577cb4d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:46.684543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888abeca-bc13-4f04-97c7-7f4c1c3a3061 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:46.736167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:46.736830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.737120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.737398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.739445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:46.757169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60959aa-61b9-4a01-a4ec-56ae15662944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:46.757993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60959aa-61b9-4a01-a4ec-56ae15662944 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.758278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60959aa-61b9-4a01-a4ec-56ae15662944 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.758555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60959aa-61b9-4a01-a4ec-56ae15662944 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.769197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:46.774224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60959aa-61b9-4a01-a4ec-56ae15662944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a60959aa-61b9-4a01-a4ec-56ae15662944 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:46.784366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:46.785282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:46.786059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 174/341] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:46.787380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc5b6-2328-4954-b54e-c90718531c3c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.787672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc5b6-2328-4954-b54e-c90718531c3c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.787950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc5b6-2328-4954-b54e-c90718531c3c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.789430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 175/342] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:46.793737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc5b6-2328-4954-b54e-c90718531c3c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:46.900251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:46.901722 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:46.929172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc5b6-2328-4954-b54e-c90718531c3c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:46.970456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:46.971158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.971447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.971725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:46.972490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:46.972802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:46.974453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08703-c5ca-42af-8a14-4af8d36b8e3f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:46.984541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 176/343] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:46.986582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:46.986856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:46.987140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.006411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:47.007661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:47.055068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:47.064970 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 168/344] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:22:47.065838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.095153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 177/345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:47.096025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.139506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:47.269483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe323c58-a469-4287-a91d-2e0181338818 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:47.286644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51457ba9-e3a3-4090-938c-dea8acb6c446 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:47.329783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:47.330689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.331186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.331621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.355724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:47.356838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.357288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.357703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.359237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:47.361590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:47.363616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 178/346] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:47.364522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.427511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:47.428924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:47.429251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:47.477039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:47.505072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7b1f-a5da-47d1-8424-760fefc7986c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:47.563544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 169/347] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:47.564214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.564407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddc0d9-3ece-45b8-8653-8b97d65cc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:47.565441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddc0d9-3ece-45b8-8653-8b97d65cc375 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.565920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddc0d9-3ece-45b8-8653-8b97d65cc375 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.566668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddc0d9-3ece-45b8-8653-8b97d65cc375 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.586481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddc0d9-3ece-45b8-8653-8b97d65cc375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5eddc0d9-3ece-45b8-8653-8b97d65cc375 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:47.596018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:47.596910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:47.597800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:47.600528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 179/348] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:47.603921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d63525-2d34-4b4c-96a1-574223b7f25b None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.604526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d63525-2d34-4b4c-96a1-574223b7f25b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.605004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d63525-2d34-4b4c-96a1-574223b7f25b None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.606775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 180/349] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:47.607729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d63525-2d34-4b4c-96a1-574223b7f25b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.705891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc9dee-175d-44f9-8549-c0ba8984a20c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:47.752540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d63525-2d34-4b4c-96a1-574223b7f25b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:47.752909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:47.753789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.754070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.754270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:47.754369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.766187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:47.767746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:47.774681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 170/350] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:47.774681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.776666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:47.808164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d72b9-c968-4f37-b1ff-3fa5d1fe3584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:47.809380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d72b9-c968-4f37-b1ff-3fa5d1fe3584 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.809899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d72b9-c968-4f37-b1ff-3fa5d1fe3584 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.810361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d72b9-c968-4f37-b1ff-3fa5d1fe3584 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.811836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d72b9-c968-4f37-b1ff-3fa5d1fe3584 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:47.813516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d72b9-c968-4f37-b1ff-3fa5d1fe3584 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:47.815586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 181/351] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:47.817063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.817519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.817954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.836248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:47.838320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:47.902519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af9b3-ef06-4de9-9fd6-bf883fda096e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:47.913390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 182/352] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:47.914496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:47.942130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:47.942810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:47.943106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:47.943719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:47.944487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:47.944955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:47.946319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:47.957653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 171/353] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:47.959992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.041372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.044650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85608-bf4c-4b7e-bfb1-fe705c3076da None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.058968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.085497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.086164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.086449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.086747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.088607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:48.088607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:48.090115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aa6a1-2603-44fc-93eb-fae5a8b58024 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:48.100564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 183/354] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:48.101140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c610b0-6452-4b89-8072-1083cdc57590 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.101430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c610b0-6452-4b89-8072-1083cdc57590 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.101709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c610b0-6452-4b89-8072-1083cdc57590 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.107661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 184/355] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:48.107661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c610b0-6452-4b89-8072-1083cdc57590 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.107926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bd94b-8183-4090-9a03-11644f5d3325 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.151897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.152879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.153164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.153442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.155443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:48.157031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:48.159159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 172/356] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:47 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:48.160029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.258390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c610b0-6452-4b89-8072-1083cdc57590 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.316052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbd4e9-7613-4168-89b2-96cc523c4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.317092 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd4e9-7613-4168-89b2-96cc523c4702 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.317663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd4e9-7613-4168-89b2-96cc523c4702 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.317941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd4e9-7613-4168-89b2-96cc523c4702 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.330319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbd4e9-7613-4168-89b2-96cc523c4702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:48.332041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b05e-b877-4d1c-a005-10052a8d91cf None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-39fbd4e9-7613-4168-89b2-96cc523c4702 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:48.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:48.339252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:48.340212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 185/357] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:48.341032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.341032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.341275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.360436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:48.361637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:48.377063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3b29-697b-4cf2-aeca-7509b05f5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.377735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3b29-697b-4cf2-aeca-7509b05f5fed None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.378018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3b29-697b-4cf2-aeca-7509b05f5fed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.378297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3b29-697b-4cf2-aeca-7509b05f5fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.380605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.381976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.457940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 186/358] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:48.459971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.460265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3b29-697b-4cf2-aeca-7509b05f5fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:48.461719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3b29-697b-4cf2-aeca-7509b05f5fed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:48.580594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90b537-d991-46cb-a778-77934b22f8a2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.591607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 173/359] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:48.593173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46fec-2c21-43f9-923e-cf13a6977728 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.593790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46fec-2c21-43f9-923e-cf13a6977728 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.594075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46fec-2c21-43f9-923e-cf13a6977728 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.596106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 174/360] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:48.602053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46fec-2c21-43f9-923e-cf13a6977728 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.629392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.630054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.630802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.631085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.632260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:48.632576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:48.635266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:48.643072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 187/361] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=825ed394374246a6a9348bca22ceafae => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:48.644040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.658113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.672658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.762079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46fec-2c21-43f9-923e-cf13a6977728 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.795307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c83e-3879-4756-bd87-0e8bcfe4e038 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.811991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.812688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.812976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.813259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.814036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:48.814349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:48.816075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:48.827470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 175/362] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:48.828496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.841920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f63b9-0ad3-4c5f-a9fd-556058c0a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.843756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f63b9-0ad3-4c5f-a9fd-556058c0a91a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.844255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f63b9-0ad3-4c5f-a9fd-556058c0a91a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.844724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f63b9-0ad3-4c5f-a9fd-556058c0a91a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.860586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f63b9-0ad3-4c5f-a9fd-556058c0a91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4c5f63b9-0ad3-4c5f-a9fd-556058c0a91a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:48.872016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:48.872978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:48.873761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 188/363] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:48.875264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.875264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.875264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.895268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:48.896460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:48.949018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:48.955694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f80f-72bb-416f-ae3f-ce9a1aef33d1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:48.993169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 189/364] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:48.993829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:48.994327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:48.994897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:48.995229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:48.995560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:48.996904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:48.998404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.001978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 176/365] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:49.002792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.017645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:49.137299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef0b48-6acf-4ba0-95a5-45b686d9c1dc None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.146910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59905c-1963-4509-b4f8-387eb92429b1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.184289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.185172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.185467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.185752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.186521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:49.186841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:49.188365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.188473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.189298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.189581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.189971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] PATH_INFO: `/v3/users/84671ef3afb7441d8044578bb3d511f7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.191421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] RBAC: Authorizing `identity:get_user(user_id=84671ef3afb7441d8044578bb3d511f7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:49.192925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.195204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 190/366] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:22:48 2022] GET /identity/v3/users/84671ef3afb7441d8044578bb3d511f7 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:49.196042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.204264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 177/367] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:49.204605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.242604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:49.299895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:49.329163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95cd2-dbea-4771-9921-5534fd9a4d29 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.348744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985986-30c2-4ea1-87fa-c2113308a79c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.386434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.387755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.388212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.388656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.390069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:49.391778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.394334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 191/368] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:49.395322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.415425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.417027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.417322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.417602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.435642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:49.448369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:49.449326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:49.450643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 178/369] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:49.451344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.542782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c60852-8c32-421a-a642-4035af78cdd6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.581148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:49.598559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec09aa-381f-4906-b2a8-0a0b78dade73 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.599264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.599946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.600233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.600512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.601363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] RBAC: Adding query filter params (role.id=d3131ec4431541ca89f6192831c24667, user.id=84671ef3afb7441d8044578bb3d511f7, scope.system=all) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:49.601688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:49.604313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.616920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 192/370] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/role_assignments?user.id=84671ef3afb7441d8044578bb3d511f7&scope.system=all&role.id=d3131ec4431541ca89f6192831c24667 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:49.617802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.621051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:49.642665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.643740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.644267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.644755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.784681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:49.786952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.802551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648179c6-f779-4dab-a73e-5475cf19ebef None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:49.852275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:49.853136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:49.853425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:49.853705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:49.854569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=191ff05bad484604bbc8843b92185783) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:49.855198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:49.857257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:49.867190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 193/371] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:49.868266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:49.958921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:49.979233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:50.006249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4833ba-a962-450d-8a13-f1e9d43d341c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.007002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 179/372] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:50.014819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.053364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.054182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.054474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.054759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.055578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:50.055920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.057825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.067674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 194/373] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:50.077869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.188546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f005-39ac-45ac-b8e3-753978b97b3d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.241447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.243488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.243488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.243488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.244767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.246323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.248526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 180/374] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:50.256027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.261981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bee8-6594-44ab-8fdd-ea8d2f6b30e3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.295415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:50.303648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.310412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.310412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.310412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.323433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:50.376565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e99d49-a884-4a42-84b4-e18205d74018 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.386630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.388592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.413770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.414464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.414874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.415292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.417098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.418860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.420695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 181/375] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:50.428196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.502273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 195/376] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:22:50.507674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.558268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:50.637032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198f671-ad04-4673-8da9-70cff05064e6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.652240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b248-0d2b-4cdc-8597-86972dc50c0e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.682498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:50.695292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.696485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.696939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.697372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] PATH_INFO: `/v3/projects/75147bc201bf4c1086a8eadbdc968fcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.698924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=75147bc201bf4c1086a8eadbdc968fcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.700593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.702505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 196/377] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/projects/75147bc201bf4c1086a8eadbdc968fcf => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:50.708660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.715760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.716647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.717132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.718794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.723136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=191ff05bad484604bbc8843b92185783) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:50.723638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.725507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.736427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 182/378] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=825ed394374246a6a9348bca22ceafae => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:50.835776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a215b2d-0317-4957-b7a1-385ec2512aa6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:50.838064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:50.874068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6a650-cf87-437c-b5fc-a76f8e06ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:50.875316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a650-cf87-437c-b5fc-a76f8e06ab1c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.875801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a650-cf87-437c-b5fc-a76f8e06ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.876254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a650-cf87-437c-b5fc-a76f8e06ab1c None admin] PATH_INFO: `/v3/groups/d843a736951e4f359f1296be19c6230a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.883540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6a650-cf87-437c-b5fc-a76f8e06ab1c None admin] RBAC: Authorizing `identity:get_group(group_id=d843a736951e4f359f1296be19c6230a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:50.885604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6a650-cf87-437c-b5fc-a76f8e06ab1c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:50.887659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 197/379] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/groups/d843a736951e4f359f1296be19c6230a => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:50.893782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:50.907684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0865-a00e-4bae-88b3-17a6f4edba06 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.910759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0865-a00e-4bae-88b3-17a6f4edba06 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.911308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0865-a00e-4bae-88b3-17a6f4edba06 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.912938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 198/380] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:50.944746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:50.945308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:50.945788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:50.977068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:50.978729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:51.064110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19a2c-f193-408a-9ee2-cf2cf5a63b38 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:51.093256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 199/381] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:51.109402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:51.110446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.110948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.111559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.112583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] RBAC: Adding query filter params (group.id=d843a736951e4f359f1296be19c6230a, role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=75147bc201bf4c1086a8eadbdc968fcf) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:51.113077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:51.114698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:51.117858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:51.125264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 183/382] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:50 2022] GET /identity/v3/role_assignments?group.id=d843a736951e4f359f1296be19c6230a&scope.project.id=75147bc201bf4c1086a8eadbdc968fcf&role.id=cc12091eec434ea294a879c1b207931e => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:51.247445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:51.258449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc93576-9a68-4b97-a094-5c1981051826 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:51.311267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:51.312953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.313491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.313947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.332920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:51.341454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:51.342427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:51.343394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:51.345928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 200/383] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:51.351732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:51.411991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:51.461798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df26e6-fda0-4331-abea-c25426b2ccc0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:51.498002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:51.498680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.498964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.499275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.500130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:51.500442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:51.501840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:51.512284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 184/384] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:51.518178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:51.646489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dc3bb-4e87-45a0-aad3-3bdccadc1736 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:51.686464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bdd47-c11b-4e07-a5e9-d75a5468d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:51.687454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bdd47-c11b-4e07-a5e9-d75a5468d81d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.687738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bdd47-c11b-4e07-a5e9-d75a5468d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.688016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bdd47-c11b-4e07-a5e9-d75a5468d81d None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.689209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bdd47-c11b-4e07-a5e9-d75a5468d81d None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:51.690751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bdd47-c11b-4e07-a5e9-d75a5468d81d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:51.692710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 201/385] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:51 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:51.698210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:51.826653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223a57-d8eb-4cc0-8329-bad4d35f8dd7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.826972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223a57-d8eb-4cc0-8329-bad4d35f8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.827250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223a57-d8eb-4cc0-8329-bad4d35f8dd7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.828722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 202/386] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:51.834104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.834396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.834675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.839785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2603b46-367c-4664-ab4b-92294edf08c6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:51.861638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:51.862840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:51.867638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:51.887712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:51.914204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:51.915003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:51.915315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:51.916126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:51.917615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:51.919915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:51.922402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 185/387] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:51 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:51.931909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:52.003968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 203/388] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:52.030444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:52.066157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55364-2226-4fb8-baca-4c11bb7ed0a8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:52.108479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:52.109377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:52.109697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:52.110006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/groups/75222488731943b1b2619d3c79f84ad3/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:52.112092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] RBAC: Authorizing `identity:create_grant(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c, group_id=75222488731943b1b2619d3c79f84ad3, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:52.114024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:52.191445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884492fb-5a49-4842-9d67-b8484e3d84f8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:52.205165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 186/389] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 23 15:22:51 2022] PUT /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/groups/75222488731943b1b2619d3c79f84ad3/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:52.250215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:52.251130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:52.251410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:52.251689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:52.265607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:52.278136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:52.279124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:52.279933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:52.280549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 204/390] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:52.287709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:52.346387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:52.412199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff5ca-3323-4d41-a385-1fca8789e77c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:52.455930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:52.456582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:52.456870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:52.457149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:52.457910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:52.458219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:52.459688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:52.469944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 187/391] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:52.475791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:52.491953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:52.597459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ea9c-27d2-46b6-91d0-7258ba8ae89e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:52.636644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:52.637581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:52.638069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:52.638546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:52.640887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:52.643593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:52.646342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 205/392] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:52 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:52.653062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:52.773206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972de5-2940-4e71-a5b4-8f26519ff149 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:52.774833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:52.810223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787026c-7357-4f55-b1fa-dd24b96692ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:52.811114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787026c-7357-4f55-b1fa-dd24b96692ac None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:52.811404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787026c-7357-4f55-b1fa-dd24b96692ac None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:52.811682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787026c-7357-4f55-b1fa-dd24b96692ac None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:52.812895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787026c-7357-4f55-b1fa-dd24b96692ac None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:52.814344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787026c-7357-4f55-b1fa-dd24b96692ac None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:52.816510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 188/393] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:52 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:52.822728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:52.920435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:52.949708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d128-4d4e-4755-bef0-4657e87a400b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:52.996169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7f5a6-5b4f-4be4-81ae-2d864fe2b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:52.997095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f5a6-5b4f-4be4-81ae-2d864fe2b6bd None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:52.997383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f5a6-5b4f-4be4-81ae-2d864fe2b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:52.997666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f5a6-5b4f-4be4-81ae-2d864fe2b6bd None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/groups/75222488731943b1b2619d3c79f84ad3/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.001661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f5a6-5b4f-4be4-81ae-2d864fe2b6bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c, group_id=75222488731943b1b2619d3c79f84ad3, role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:53.003158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f5a6-5b4f-4be4-81ae-2d864fe2b6bd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:53.119151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 206/394] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 23 15:22:52 2022] PUT /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c/groups/75222488731943b1b2619d3c79f84ad3/roles/825ed394374246a6a9348bca22ceafae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:53.344191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf83eb-abdf-4349-8687-2d051dbcd845 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.344822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf83eb-abdf-4349-8687-2d051dbcd845 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.345296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf83eb-abdf-4349-8687-2d051dbcd845 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.347220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 189/395] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:53.366710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc252a1-c8a8-4292-a0d3-0dd75b4feb93 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.367061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc252a1-c8a8-4292-a0d3-0dd75b4feb93 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.367302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc252a1-c8a8-4292-a0d3-0dd75b4feb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.392399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4dc252a1-c8a8-4292-a0d3-0dd75b4feb93 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:53.393551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4dc252a1-c8a8-4292-a0d3-0dd75b4feb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:53.466659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 207/396] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:53.494540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf83eb-abdf-4349-8687-2d051dbcd845 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:53.499082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146223-357d-4ea8-91a3-80b9843461cb None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.499499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146223-357d-4ea8-91a3-80b9843461cb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.499689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146223-357d-4ea8-91a3-80b9843461cb None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.502311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 208/397] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:53.508235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.508549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.508837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.530714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:53.532261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:53.632307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:53.646361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 209/398] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:53.670658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf83eb-abdf-4349-8687-2d051dbcd845 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:53.689360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:53.735150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:53.736787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.737077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.737357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.760256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:53.768238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:53.769087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:53.769860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:53.776060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 190/399] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:53.780566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:53.842842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:53.889530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf931b-cd59-4326-a2e0-0c80dae08fa5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:53.925248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d6b1-0774-461c-91c5-69821be62759 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:53.962180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:53.963164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.963589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.964001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:53.965005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:53.965444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:53.966933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:53.976156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 191/400] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:53.984712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:53.984965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:53.986071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:53.986567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:53.987031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.000438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:54.011081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:54.012019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:54.012784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:54.015865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 210/401] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:54.024610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.108813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc536-36f4-45e0-926d-b7b5b6222efb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.120133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.146038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06ce8b-b7d4-4d7b-bee2-4be9eb6294d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.146905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06ce8b-b7d4-4d7b-bee2-4be9eb6294d8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.147221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06ce8b-b7d4-4d7b-bee2-4be9eb6294d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.147501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06ce8b-b7d4-4d7b-bee2-4be9eb6294d8 None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.149042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.149685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06ce8b-b7d4-4d7b-bee2-4be9eb6294d8 None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:54.151190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06ce8b-b7d4-4d7b-bee2-4be9eb6294d8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:54.152993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 192/402] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:53 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:54.154126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652242-d818-41ba-87ba-8c7de5970f78 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.154419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652242-d818-41ba-87ba-8c7de5970f78 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.154700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652242-d818-41ba-87ba-8c7de5970f78 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.156193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 193/403] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:54.160486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652242-d818-41ba-87ba-8c7de5970f78 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.199549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3cf0-36b6-4434-a861-971803840463 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.245392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.247109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.247561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.247939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.248822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:54.249233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:54.250792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406c46-11c3-4691-8f6f-5149cfdefa49 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:54.267126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 211/404] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:54.267126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.267126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.267126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.285247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652242-d818-41ba-87ba-8c7de5970f78 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.290010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:54.291895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:54.326624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.327144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.327950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.328327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.331555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:54.333394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:54.335340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 194/405] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:54 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:54.340897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.382170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.388288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 212/406] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:54.395136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.460950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.476874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd21d7-3df7-4b32-981a-354464d51584 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.518940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.520118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4faa8-a0a3-4c94-a97e-fbfc2c5e0992 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.521063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.521493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.521916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.523299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:54.525473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:54.531175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 195/407] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:54 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:54.532224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.564879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.565800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.566086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.566390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783/groups/75222488731943b1b2619d3c79f84ad3/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.569604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] RBAC: Authorizing `identity:create_grant(project_id=191ff05bad484604bbc8843b92185783, group_id=75222488731943b1b2619d3c79f84ad3, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:54.571076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:54.643890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.647006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 213/408] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 23 15:22:54 2022] PUT /identity/v3/projects/191ff05bad484604bbc8843b92185783/groups/75222488731943b1b2619d3c79f84ad3/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:54.648252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.660240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa582863-78e3-4d5e-a4c6-77027cffc966 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.733714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.734865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.735387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.735847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.759018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:54.767842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:54.768794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:54.769574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:54.772025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 196/409] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:54.778471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.816752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a907-e05c-4f00-83e9-ce1b59b6fe1b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.830357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.854847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.855929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.856458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.856832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:54.858222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:54.860057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:54.862400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 214/410] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:54 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:54.868453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:54.960223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780ddf-1239-4a1e-a265-0f51b2a1b96c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:54.996968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:54.998139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:54.998631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:54.999156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.000116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:55.000629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:55.002216 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:55.007005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc960-6899-463d-b08c-e8e82ba15249 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:55.012403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 197/411] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:55.018544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:55.040141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:55.047423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7a54-9040-4543-9e11-83f369aed389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:55.048311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7a54-9040-4543-9e11-83f369aed389 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.054503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7a54-9040-4543-9e11-83f369aed389 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.054503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7a54-9040-4543-9e11-83f369aed389 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783/groups/75222488731943b1b2619d3c79f84ad3/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.054503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f7a54-9040-4543-9e11-83f369aed389 None admin] RBAC: Authorizing `identity:create_grant(project_id=191ff05bad484604bbc8843b92185783, group_id=75222488731943b1b2619d3c79f84ad3, role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:55.054503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f7a54-9040-4543-9e11-83f369aed389 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:55.129770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 215/412] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 23 15:22:54 2022] PUT /identity/v3/projects/191ff05bad484604bbc8843b92185783/groups/75222488731943b1b2619d3c79f84ad3/roles/825ed394374246a6a9348bca22ceafae => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:22:55.139245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cb804-844d-4353-a689-96c7a07368c4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:55.154390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059bc1-6aa0-49c0-95af-72ad2268d868 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.154675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059bc1-6aa0-49c0-95af-72ad2268d868 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.154952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50059bc1-6aa0-49c0-95af-72ad2268d868 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.156481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 216/413] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:55.162693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.162867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.163188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.186177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:55.187115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.187405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.187678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] PATH_INFO: `/v3/groups/d843a736951e4f359f1296be19c6230a` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.191797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] RBAC: Authorizing `identity:get_group(group_id=d843a736951e4f359f1296be19c6230a)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:55.193286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:55.195045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 198/414] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:55 2022] GET /identity/v3/groups/d843a736951e4f359f1296be19c6230a => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:55.202023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:55.209683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:55.210885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:55.273700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:55.363613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 217/415] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:55.387967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:55.406679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:55.423645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cf75a-2b81-414d-a1ce-d966d63be3bc None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:55.468654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:55.469590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.469883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.470164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] PATH_INFO: `/v3/projects/75147bc201bf4c1086a8eadbdc968fcf` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.474302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] RBAC: Authorizing `identity:get_project(project_id=75147bc201bf4c1086a8eadbdc968fcf)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:55.475805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:55.477538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 199/416] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:55 2022] GET /identity/v3/projects/75147bc201bf4c1086a8eadbdc968fcf => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:55.484816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:55.531688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae511c-1fdf-44aa-b0f0-b8333030dd18 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:55.616133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:55.616944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.617230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.617512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.656356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:55.669823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:55.670740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:55.671552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:55.680490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14c513-c512-42ee-8aeb-93ea4296b79a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:55.682810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 218/417] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:55.685840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:55.749614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:55.757052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442665-14db-4302-955f-6768b9318b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:55.757946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442665-14db-4302-955f-6768b9318b62 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.763583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442665-14db-4302-955f-6768b9318b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.763583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442665-14db-4302-955f-6768b9318b62 None admin] PATH_INFO: `/v3/projects/75147bc201bf4c1086a8eadbdc968fcf/groups/d843a736951e4f359f1296be19c6230a/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.763583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e442665-14db-4302-955f-6768b9318b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=75147bc201bf4c1086a8eadbdc968fcf, group_id=d843a736951e4f359f1296be19c6230a, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:55.763583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e442665-14db-4302-955f-6768b9318b62 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:55.828092 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dc264-98ef-4816-8157-f7eea09be78a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:55.834191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 200/418] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 23 15:22:55 2022] PUT /identity/v3/projects/75147bc201bf4c1086a8eadbdc968fcf/groups/d843a736951e4f359f1296be19c6230a/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:22:55.835717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe7e16-6e48-4ac7-a964-1be85fd6210b None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.836303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe7e16-6e48-4ac7-a964-1be85fd6210b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.836725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe7e16-6e48-4ac7-a964-1be85fd6210b None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.844662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 201/419] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:55.847730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.848035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.848330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.867126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:55.868447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:55.877058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:55.878035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:55.878528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:55.879175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:55.880240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:55.881516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:55.882041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:55.883716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:55.894787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 219/420] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:55.902753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:55.944612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 202/421] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:56.022819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:56.039419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.054852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291b37-100c-4d01-ae8e-d35827faebe8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:56.097443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:56.098423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:56.100213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:56.100707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:56.188150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:56.189862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:56.193392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f81202-f3ec-4bc8-bc1b-47ad2c5e9a4d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:56.246919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:56.246919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:56.246919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:56.246919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:56.270414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:56.290572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:56.291696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:22:56.292713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 203/422] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:22:56.304050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:56.326867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.341781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.356203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 220/423] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:56.361960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:56.521680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c730a1-f53e-4ce1-a3f6-59065fe66f28 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:56.547005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc49a-c345-48ec-9a73-6c9a99d53d96 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:56.581229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:56.581914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:56.582205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:56.582486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:56.583280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:56.583597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:56.584991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:56.585608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:56.586739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:56.587022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:56.587377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:56.588574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:56.590025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:56.592074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 221/424] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:56.600674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:56.610977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 204/425] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:56.616102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:56.686434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.688963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.723553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6902f5-7d61-4b42-ae10-005cc6abebad None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:56.735801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc2008-25f2-47c5-a013-33a5c0f5a896 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:56.759210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:56.760375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:56.760664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:56.760942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:56.803821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:56.805066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:56.805563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:56.806560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:56.808075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:56.809762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:56.811977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 222/426] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:56.827321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:56.837055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:56.838554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:56.905928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.944553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 205/427] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:56.949610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.042950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2c09d-7731-41a5-b18a-ab8e79c112cd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:57.082047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47814-9389-40a8-b644-06d59b64dcca None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:57.102235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:57.127871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:57.129443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.130282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:57.131406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.131918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.132422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.133491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:57.134010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.135023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] PATH_INFO: `/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.139763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:57.139763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa0584-62d3-4065-85fe-ee5f3fdd62cc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:57.140746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] RBAC: Authorizing `identity:get_project(project_id=d86cecb3df3346b2aace7b7ac6d7ed4c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:57.143574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:57.149338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 206/429] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/projects/d86cecb3df3346b2aace7b7ac6d7ed4c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:57.149528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 223/429] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:56 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 611 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:57.156324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.217132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:57.302972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec4b6-dc72-4521-9ce0-5892880a0a1e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.303353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec4b6-dc72-4521-9ce0-5892880a0a1e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.303571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec4b6-dc72-4521-9ce0-5892880a0a1e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.306896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 224/430] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:57.311368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.311656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.311939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.330655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:57.331562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:57.342229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad7b6-cc1f-4e95-b1b1-f522766f5d66 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:57.397635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:57.398495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.398775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.399052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.400536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:57.402153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:57.404414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 207/431] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:57 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:57.410052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.417038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 225/432] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:57.440340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.521514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b679-b590-41d5-9394-6a6f71ffb52e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:57.523745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:57.568741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbc2c2-8253-477a-8b54-14fd03d36dca None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:57.571190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:57.573450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.573898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.574318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.575354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:57.575830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:57.577402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:57.586061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 208/433] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:57 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=d86cecb3df3346b2aace7b7ac6d7ed4c&role.id=825ed394374246a6a9348bca22ceafae => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:57.597820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:57.617930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec506-974a-41fb-8bcb-787e02b96120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:57.619562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec506-974a-41fb-8bcb-787e02b96120 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.620238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec506-974a-41fb-8bcb-787e02b96120 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.622985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec506-974a-41fb-8bcb-787e02b96120 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.639156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ec506-974a-41fb-8bcb-787e02b96120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9d8ec506-974a-41fb-8bcb-787e02b96120 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:57.648735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:57.649811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:22:57.650586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:57.654775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 226/434] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:57.656235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.726991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54031be-2916-4059-a9dc-c291fae1f2ea None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.727303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54031be-2916-4059-a9dc-c291fae1f2ea None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.727507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54031be-2916-4059-a9dc-c291fae1f2ea None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.729953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 227/435] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:57.737781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.738074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.738345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.764825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:57.766044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:57.785357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a08e6-c4eb-4522-8371-b753c8c27d31 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:57.826969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:57.827664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:57.827953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:57.828225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:57.828992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:57.829293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:57.830648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:57.841628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 209/436] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:57.847331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.854708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 228/437] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:22:57.878769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:57.881661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:57.965037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637200-f9c0-4a6b-a1db-fd2b684078c7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.003314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be107-467f-4f21-a63a-ca4288cd9674 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.005571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.006319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.007481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.007798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.022043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.047424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.048243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.048524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.048796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.065433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:58.074385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:58.075591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:22:58.076388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:58.079039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 229/438] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:22:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:58.084273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.092655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.094128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.123774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.198289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37b9ae-e108-4cab-af94-4d2de3925f8a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.208577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 210/439] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:22:58.213968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.240754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.241509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.241795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.242073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.242823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:58.243162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.245094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.254035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 230/440] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:58.259956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.292535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.322697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6656c9-8644-4782-8ca7-7657e52ecf4e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.351467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.359585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.360454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.360733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.361006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.362237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.363833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.364180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c090-ab16-4d21-a88c-92cca8d2cea0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.365691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 211/441] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:58.371360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.402156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.402811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.403108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.403399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.474915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.475130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dfa44-9b35-4213-a582-7f38aa797c92 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.476564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.510759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.511495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.511649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.511821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.512101 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.513279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.514698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.516664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 212/442] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:58.522269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.592990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 231/443] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:22:58.593554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.594611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.630205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a46b-0712-44d6-ada2-5a4a3d30131b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.668200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.668867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.669153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.669434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.670364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=0f3b3ee617cb4eeb9055e6e42f163ed4, scope.project.id=191ff05bad484604bbc8843b92185783) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:58.670681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.672135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.678272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 213/444] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:58.722415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec53143-3d7c-43c5-bad7-db7edfcba24f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.756117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.769230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7defcd7-292b-409a-95ca-36bfffd75a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.769230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7defcd7-292b-409a-95ca-36bfffd75a16 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.769230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7defcd7-292b-409a-95ca-36bfffd75a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.769230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7defcd7-292b-409a-95ca-36bfffd75a16 None admin] PATH_INFO: `/v3/projects/191ff05bad484604bbc8843b92185783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.769578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7defcd7-292b-409a-95ca-36bfffd75a16 None admin] RBAC: Authorizing `identity:get_project(project_id=191ff05bad484604bbc8843b92185783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.769578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7defcd7-292b-409a-95ca-36bfffd75a16 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.769578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 232/445] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/projects/191ff05bad484604bbc8843b92185783 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:58.774522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.776165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc6057-90e8-4fe0-8c4a-4deae66da199 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.776460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc6057-90e8-4fe0-8c4a-4deae66da199 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.776737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc6057-90e8-4fe0-8c4a-4deae66da199 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.778280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 233/446] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:22:58.783979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.784270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.784550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.803879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:58.805123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:58.883544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 234/447] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:22:58.897186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903561-9f99-4cc0-815f-0cf676aa3057 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:58.907211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:58.928360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:58.938545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:58.939644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:58.940252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:58.940538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] PATH_INFO: `/v3/groups/75222488731943b1b2619d3c79f84ad3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:58.942818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] RBAC: Authorizing `identity:get_group(group_id=75222488731943b1b2619d3c79f84ad3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:58.944770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:58.946251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 214/448] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/groups/75222488731943b1b2619d3c79f84ad3 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:58.952645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:59.030243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1fabd-8932-49f7-8152-bcd6a9910d31 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.063196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:59.066490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6da27-9790-4708-b130-2823ca9ab2ef None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.073081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.078321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.078321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.078321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.085731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:22:59.094051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:22:59.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:22:59.095865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 235/449] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:22:59.101261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:59.101693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.102355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.102641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.103497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.104338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] RBAC: Adding query filter params (group.id=75222488731943b1b2619d3c79f84ad3, role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=191ff05bad484604bbc8843b92185783) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:59.104654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:59.106077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:59.111965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 215/450] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:58 2022] GET /identity/v3/role_assignments?group.id=75222488731943b1b2619d3c79f84ad3&scope.project.id=191ff05bad484604bbc8843b92185783&role.id=825ed394374246a6a9348bca22ceafae => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:59.206463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a251fc-6657-4ac1-9c71-8465a81143a2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.244543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.245228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.245547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.245829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.246604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:59.246923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:59.248395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:59.257322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 236/451] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:22:59.263638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:59.324309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:59.365198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51e15-6f4b-4eb5-b841-1bf0a7469b53 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.400615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.401270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.401548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.401816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.468790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:59.470255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:59.525983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:59.565455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 216/452] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:22:59.571036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:59.619871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:59.668324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049759-2963-4bc7-8704-c2836a6dae4d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.701657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.701943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.702222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] PATH_INFO: `/v3/projects/75147bc201bf4c1086a8eadbdc968fcf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.703428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] RBAC: Authorizing `identity:get_project(project_id=75147bc201bf4c1086a8eadbdc968fcf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:59.704873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:59.706534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 237/453] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:22:59 2022] GET /identity/v3/projects/75147bc201bf4c1086a8eadbdc968fcf => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:59.711948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:59.807367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7507d5-d88d-4c07-a160-2dc1e7b157cf None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.839877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced8214-752b-4921-af33-84dbcba8bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.840716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8214-752b-4921-af33-84dbcba8bd6f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.840996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8214-752b-4921-af33-84dbcba8bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.841279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8214-752b-4921-af33-84dbcba8bd6f None admin] PATH_INFO: `/v3/groups/d843a736951e4f359f1296be19c6230a` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.842416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced8214-752b-4921-af33-84dbcba8bd6f None admin] RBAC: Authorizing `identity:get_group(group_id=d843a736951e4f359f1296be19c6230a)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:59.843870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced8214-752b-4921-af33-84dbcba8bd6f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:59.845457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 217/454] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 23 15:22:59 2022] GET /identity/v3/groups/d843a736951e4f359f1296be19c6230a => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:22:59.851524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:59.947365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e7696-9502-4281-96a6-3b74aefdc23e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:59.963117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:59.979749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:59.980498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:59.980782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:59.981057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:59.981880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] RBAC: Adding query filter params (group.id=d843a736951e4f359f1296be19c6230a, role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=75147bc201bf4c1086a8eadbdc968fcf) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:22:59.982192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:59.983653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465b74b-b133-4120-98bb-80384fa67f2c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:59.989323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 238/455] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 23 15:22:59 2022] GET /identity/v3/role_assignments?group.id=d843a736951e4f359f1296be19c6230a&scope.project.id=75147bc201bf4c1086a8eadbdc968fcf&role.id=cc12091eec434ea294a879c1b207931e => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:02.858113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7c04-0619-492e-86be-043043b3451a None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:02.859016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7c04-0619-492e-86be-043043b3451a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:02.859467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7c04-0619-492e-86be-043043b3451a None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:02.861257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 218/456] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:02.867015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c754a-6ee7-4cd6-909c-1542101b0699 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:02.867874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c754a-6ee7-4cd6-909c-1542101b0699 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:02.868297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c754a-6ee7-4cd6-909c-1542101b0699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:02.880386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3943dcc-a156-4d68-a740-9ca00c86e555 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:02.880983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3943dcc-a156-4d68-a740-9ca00c86e555 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:02.881519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3943dcc-a156-4d68-a740-9ca00c86e555 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:02.883367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 219/457] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:02.889078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390274be-780f-445d-97ed-bc28044922ba None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:02.889597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390274be-780f-445d-97ed-bc28044922ba None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:02.890071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390274be-780f-445d-97ed-bc28044922ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:02.892581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2a5c754a-6ee7-4cd6-909c-1542101b0699 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:02.894379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2a5c754a-6ee7-4cd6-909c-1542101b0699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:02.918926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-390274be-780f-445d-97ed-bc28044922ba None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:02.920145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-390274be-780f-445d-97ed-bc28044922ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:02.968807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:02.999699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 239/458] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:03.006246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a3b6-7c38-41f5-9608-85d5c751a89d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.006535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a3b6-7c38-41f5-9608-85d5c751a89d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.006971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a3b6-7c38-41f5-9608-85d5c751a89d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.008760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 240/459] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:03.014280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.014782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.015311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.036559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 220/460] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:03.037816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390274be-780f-445d-97ed-bc28044922ba None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.044105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:03.046343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:03.147195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 241/461] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:03.147195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.196203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390274be-780f-445d-97ed-bc28044922ba None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.196401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:03.245574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.246583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.247008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.248056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.262460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.264789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.277034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb5b16-92ff-4368-86e2-79e5fbdf0fad None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:03.289142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:03.290024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:03.290925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:03.290925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:03.290925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:03.290925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:03.293310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 221/462] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:03.294749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.311749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:03.318820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.327149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.327149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.327149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.332106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.333772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:03.353417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:03.354411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:03.355461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:03.355461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:03.355461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:03.355461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:03.360334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 242/463] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:03.360334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.426409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156926-7afb-4646-a3cb-50a2ebcb784d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.458422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:03.462117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.462920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.463262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.463558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.465310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e4622-046d-49d5-aecf-91f556860450 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.476130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.477575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:03.496697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:03.497654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:03.498482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:03.498482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:03.498482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:03.498482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:03.502707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 222/464] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:03.503611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.504185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.504854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.505424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.506259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:03.506439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.507870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988d4a-46ef-4be6-887c-bd3cdc1c55c1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.529243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 243/465] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:03.530814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333a67-30f5-4fb3-8a0e-d6161f3d9ac6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.531128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333a67-30f5-4fb3-8a0e-d6161f3d9ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.531405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333a67-30f5-4fb3-8a0e-d6161f3d9ac6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.532737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 244/466] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:03.533311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd333a67-30f5-4fb3-8a0e-d6161f3d9ac6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.573469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:03.613455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8471b8-781d-4e5c-ad8e-574254788486 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.641141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd333a67-30f5-4fb3-8a0e-d6161f3d9ac6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.648785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.649452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.650257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.650530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.651399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:03.651760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.653308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.666659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 223/467] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:03.671307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.682333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.683276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.683565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.683850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.684583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:03.684895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.686284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bfcb1-a275-4ecc-a658-d9ebcabc2e46 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.699087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 245/468] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:03.700358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.700646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.700932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.718047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:03.719263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:03.728982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:03.786390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e498f-2426-4786-aab2-285098891e48 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.795588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 246/469] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:03.797055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.809888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:03.824755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.825432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.825714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.825990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.826728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.828266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:03.910117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327ea40-4474-4b98-aca1-83f3e03bdaf4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:03.931135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 224/470] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:23:03 2022] POST /identity/v3/users => generated 246 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:03.931135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:03.958222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:03.958815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:03.959139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:03.959400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:03.960124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:03.961673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:04.033508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:04.038103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 247/471] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:23:03 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:04.038942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:04.058893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d380cc7-1294-4291-a028-a54eadb628cd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:04.113303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00b1c-5b19-4a3d-b416-618578c6affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:04.114432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00b1c-5b19-4a3d-b416-618578c6affa None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.114917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00b1c-5b19-4a3d-b416-618578c6affa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.115396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00b1c-5b19-4a3d-b416-618578c6affa None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.116298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00b1c-5b19-4a3d-b416-618578c6affa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:04.118168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00b1c-5b19-4a3d-b416-618578c6affa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:04.180281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24375f8-777e-4f75-9e0e-41eb761b0421 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:04.218718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 225/472] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:23:03 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:04.220678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccddbb6-3c78-4b18-8453-5b1d5d354050 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.221220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccddbb6-3c78-4b18-8453-5b1d5d354050 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.221764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccddbb6-3c78-4b18-8453-5b1d5d354050 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.226707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 226/473] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:04.228268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:04.229086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.229371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.229647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.232750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.233364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.233820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.249426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:04.251420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:04.263256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:04.265898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:04.276051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:04.276975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:04.278169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:04.278169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:04.278169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:04.278169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:04.278169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 248/474] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:04.285029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:04.315565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:04.361435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:04.371120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 227/475] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:04.401863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:04.434632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc11a-7dee-4a39-a8ba-36354d8e1895 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:04.471532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:04.472540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.473143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.473671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.474873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:04.475469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:04.477325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:04.492936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 249/476] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:04.500062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:04.525746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5899c4-99e8-4c02-bbf4-6863d2b9e087 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:04.571607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:04.572519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.572811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.573088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.574370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:04.576090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:04.612419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.sql.core [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:23:04.612419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 15:23:04.612419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [parameters: {'id': '2875dd5d084c4d338e4b6b7153909d7a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 15:23:04.612419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application conn.query(q) May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result.read() May 23 15:23:04.637562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return ref.to_dict() May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:23:04.638477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application next(self.gen) May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application yield resource May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application next(self.gen) May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise self.value May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application session.commit() May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:23:04.639435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.session.flush() May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application compat.raise_( May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:23:04.640276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:23:04.641152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application conn.query(q) May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result.read() May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:23:04.641966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [parameters: {'id': '2875dd5d084c4d338e4b6b7153909d7a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:04.642744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 15:23:04.647271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:04.649402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 228/477] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 23 15:23:04 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:04.649782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa787e9d-a33b-486c-a632-4968b386de12 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:04.652911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:04.668245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:04.698193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:04.699829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.701771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.702195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.703054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:04.706357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:04.723570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:04.792661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 250/478] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:23:04 2022] POST /identity/v3/users => generated 249 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:23:04.811203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abeec5-4769-42a5-bd02-7a626d1b560f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:04.859546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac4a6-2f70-4f90-9bc8-e9655adf2d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:04.860631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac4a6-2f70-4f90-9bc8-e9655adf2d62 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:04.861062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac4a6-2f70-4f90-9bc8-e9655adf2d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:04.861479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac4a6-2f70-4f90-9bc8-e9655adf2d62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:04.876907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac4a6-2f70-4f90-9bc8-e9655adf2d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-da1ac4a6-2f70-4f90-9bc8-e9655adf2d62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:04.885708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:04.886822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:23:04.887830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:04.894377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 229/479] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:04.900813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:05.051844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6b0c-2e69-4bdf-a7e9-b625d520c972 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:05.100864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:05.101539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:05.101822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:05.102098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:05.102882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:05.103215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:05.104608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbe3f7-90a5-4297-8245-0a86f0a0de77 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:05.117750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 251/480] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:06.510247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602347e-1be5-4c17-b42b-13e9eee8d146 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:06.511201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602347e-1be5-4c17-b42b-13e9eee8d146 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:06.511678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602347e-1be5-4c17-b42b-13e9eee8d146 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:06.513736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 230/481] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:06.518739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ccb4-3698-4b04-97a4-6f15c81dac0f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:06.519252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ccb4-3698-4b04-97a4-6f15c81dac0f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:06.519423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ccb4-3698-4b04-97a4-6f15c81dac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:06.537382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a756ccb4-3698-4b04-97a4-6f15c81dac0f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:06.538597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a756ccb4-3698-4b04-97a4-6f15c81dac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:06.578860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:06.651134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 252/482] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:06.749656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602347e-1be5-4c17-b42b-13e9eee8d146 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:06.882523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47ef7-e1b0-450e-bfa7-71687518a583 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:06.882859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47ef7-e1b0-450e-bfa7-71687518a583 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:06.883037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47ef7-e1b0-450e-bfa7-71687518a583 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:06.884943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 253/483] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:06.889723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70f0ef-3382-463c-8248-5a55bf21afe6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:06.890008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70f0ef-3382-463c-8248-5a55bf21afe6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:06.890292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70f0ef-3382-463c-8248-5a55bf21afe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:06.896402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:06.920459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602347e-1be5-4c17-b42b-13e9eee8d146 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:06.946185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fb70f0ef-3382-463c-8248-5a55bf21afe6 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:06.948067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fb70f0ef-3382-463c-8248-5a55bf21afe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:07.028207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.029012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.029296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.029570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.052455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 254/484] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:07.055118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd7ec-00da-4f6b-8cd4-0888542bd978 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.055118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd7ec-00da-4f6b-8cd4-0888542bd978 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.055118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd7ec-00da-4f6b-8cd4-0888542bd978 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.059116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 255/485] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:07.059224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:07.063282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.063573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.063861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:07.074549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:07.075451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:07.076252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:07.078918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 231/486] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:07.079833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.092041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:07.093882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:07.183443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 256/487] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:07.184252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.212535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76812c7-5517-4530-a045-ac5e3f2ad765 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.222517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.257900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.259756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.260230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.261512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.280201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:07.290658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:07.291857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:07.292851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:07.296261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 232/488] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:07.297275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.310575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.333541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47203b9c-631f-4961-a223-cfaed4768034 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.381613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.382439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.382878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.383299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.384871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:07.385475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:07.387064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:07.395672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 257/489] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:07.396622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.416504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe8111-c503-4e89-9440-41525d91b813 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.460680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.469015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.469460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.469923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.481954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:07.485508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:07.490099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:07.490976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:07.491791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:07.495125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 233/490] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:07.496128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.510569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd0ad-cf47-473b-9141-8ec5562edabd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.547918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.548583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.548860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.549140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.549963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:07.550274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:07.551777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:07.561384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 258/491] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:07.566358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.570160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.605619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e159d4-97a3-44fe-962b-b8daaa4b7fb0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.646174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.647404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.647887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.648372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.660271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:07.662048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:07.677441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220e23d-ec29-4d54-9c89-f663b409dbc9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:07.681738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:07.682545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:07.683502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:07.683502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:07.683502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:07.683502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:07.685368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 234/492] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:07.686435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.714705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.715437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.715791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.716142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.717021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:07.717396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:07.718952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:07.728703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 259/493] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:07.734127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.744006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.796430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5996-14d9-44b7-9e67-dc9622853ec2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.818421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.836114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.837533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.837821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.838094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.849557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991de27-8cc1-472b-953a-2e18eaa252c9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:07.849708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:07.851442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:07.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:07.876348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:07.877185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:07.877185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:07.877185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:07.877185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:07.878182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 235/494] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:07.879062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.888845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:07.889768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.890233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.890687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.891624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:07.892133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:07.893708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0457d1-fba6-409a-8ffa-990412da99c4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:07.910618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 260/495] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:07.910618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db9c3e-d223-4d14-913a-f1b995b7b49e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:07.910618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db9c3e-d223-4d14-913a-f1b995b7b49e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:07.910618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db9c3e-d223-4d14-913a-f1b995b7b49e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:07.910618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 261/496] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:07.910618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db9c3e-d223-4d14-913a-f1b995b7b49e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:07.987513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:07.998029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d9c35-04ea-432c-9e52-6d89048d7f07 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.023988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db9c3e-d223-4d14-913a-f1b995b7b49e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.031941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.032741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.033026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.033303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.045141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.046602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.061683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.062345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.062629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.062908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:08.063394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:08.064186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:08.065013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:08.065013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:08.065013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:08.065013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:08.065217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:08.065217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.065341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3840205-1c94-4d19-abdd-e48ce0b62946 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.069162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 236/497] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:08.070031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.081800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 262/498] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:08.081800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.081800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.081800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.096342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:08.097527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:08.100553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.168514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 263/499] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:08.169363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.189209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d96ec-3804-49f5-bdce-41c8d48eb4fb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.224373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.225166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.225448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.225721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.234695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.236034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.237426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:08.254239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:08.255153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:08.256099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 237/500] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:08.256689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.282340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d234c46-8e5d-4b51-8b17-924fbec06659 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.316321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.316982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.317272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.317577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.318327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:08.318637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.320046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a2a7-b563-4b55-8642-ca6b0a94d7a5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.331903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 264/501] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:08.333205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ab5f-b57f-4c03-91e5-96085eae7e9f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.333499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ab5f-b57f-4c03-91e5-96085eae7e9f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.333835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ab5f-b57f-4c03-91e5-96085eae7e9f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.335259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 265/502] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:08.335803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ab5f-b57f-4c03-91e5-96085eae7e9f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.348566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.363950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8283-92cd-448e-a24f-ced02a7703e2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.396781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.397738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.398437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.398723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.406250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.407767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:08.421790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:08.422689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:08.423608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 238/503] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:08.424158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.442642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ab5f-b57f-4c03-91e5-96085eae7e9f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.461565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.479515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.480311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.480600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.480875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.491217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.492679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f6c19de4-c21c-4c1f-b609-f5df52fc45f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:08.509923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:08.510760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:08.511647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:08.511647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:08.511647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:08.511647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:08.512373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 266/504] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:08.513781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.514074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.514352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.525932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832c1a8-3d9e-421d-8661-f14eb4aeb50a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.531161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:08.532374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:08.559904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.560568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.560851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.561129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.561955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:08.562264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.563724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.597931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 267/505] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:08.598778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.605032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 239/506] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:08.606056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.609431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.698841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.702462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac84c-1ad3-4d4e-bdfd-e319c434066d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.708715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceeb4a-92cf-4b46-a139-4ccdffbb2dbb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.736181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.736966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.737250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.737525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.741306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.741999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.742283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.742560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.744384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:08.745138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.745303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.746639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.747184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.765913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 240/507] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:08.766681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:08.771414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:08.772475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:08.773402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 268/508] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:08.773952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.828563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.869030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab09db-8538-44f0-8689-df4c0e2fa8b9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.870795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19664b-44ff-488d-93d1-0a54e2577a54 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:08.901819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.902475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.902770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.903046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.903798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:08.903998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:08.904100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.904689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:08.904974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:08.905249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:08.905470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:08.917510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 241/509] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:08.918307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:08.934273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:08.973893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:08.975759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.014454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a02d7-b2d7-4654-b462-cdbc89961c54 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.034679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.049057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.049855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.050141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.050420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.061062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:09.069088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:09.070010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:09.070806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:09.071470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 269/510] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:09.072208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.075713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 242/511] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:09.076150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.130567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.172408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4f22-e800-4df9-b4a3-d652059111a9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.181934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b00bfe-1299-40d8-85b0-4ee34b760826 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.208398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.209080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.209448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.209646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.215444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.216112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.216398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.216678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.217517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:09.217830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.219287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.238333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 243/512] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:09.239178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.279529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.284085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.285607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.337632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668d96-d580-4830-a47e-7fa1105c7b37 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.343086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.374804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.375600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.375891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.376175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.376886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.378325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.385849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 270/513] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:09.386841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.454076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 244/514] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:23:09 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:09.454903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.491033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f769-55f8-46f0-816e-b6a8e66aba38 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.532443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.533131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.533553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.533841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.534614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:09.534928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.536456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.549899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 271/515] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:09.549899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.574495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.580422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.587828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bf994-90b4-473f-be4f-0eeea190d43a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.632455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.635123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.635123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.635123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.646723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.648299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.661753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28e66-c2dc-48cf-a954-6f5966e20acc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:09.668070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:09.668987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:09.669871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:09.669871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:09.669871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:09.669871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:09.669871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 245/516] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:09.670554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.705612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.706267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.706561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.706946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.781943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.783545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.800817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0450fd-4ce4-4614-977d-d50fe2611feb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:09.805383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.841342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:09.842149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:09.842440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:09.842719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:09.854509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:09.856046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:09.862735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:09.874458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:09.881102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:09.882139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:09.882139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:09.882139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:09.882139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:09.882139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 246/517] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:09.882139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.898581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 272/518] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:09.899775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:09.990968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e389f9-5fad-4963-abb9-aa4cb8bb478c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.002822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868a17-647e-42ae-9ed6-c6f144854bc0 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.022238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.029198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.030172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.030630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.031054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.036550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.037212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.038114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.038114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.038474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:10.038785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.040748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.044377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.046013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.052315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 273/519] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:10.053068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:10.068133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:10.069023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:10.069849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:10.069849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:10.069849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:10.069849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:10.069849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 247/520] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:10.070118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.134956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.173665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451996e-6076-43f8-adce-e6a0e6f81056 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.189972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc4363-e0fb-4764-a8b8-dbbbd0e8395c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.211255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.212448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.212778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.213048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.213731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:10.214121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.215475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.231740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 274/521] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:10.231925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.232055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.232141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.232141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.232141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.244496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.246056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:10.264431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:10.265530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:10.268117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:10.268117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:10.268117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:10.268117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:10.268117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 248/522] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:10.268117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.284431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.345208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ab8a4-f4f4-45c5-bda5-5be032218297 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.378034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637502-48bc-44a9-a324-597d3294eac9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.379964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.380877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.381687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.381974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.382257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.389206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.390671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:10.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:10.407498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:10.408374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 275/523] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:10.408999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.421309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.421972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.422258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.422541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.423489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:10.423609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.424943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.440711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 249/524] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:10.440711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.517992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.521178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bb6b-5cbe-497c-a4f4-b45edbcebc1b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.548217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484992-2829-44da-bb00-1b08d3a85d8a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.556014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.556800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.557084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.557354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.564114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.565556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:10.579428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:10.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:10.581108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 276/525] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:10.581984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.588627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.589352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.589591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.589873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.590607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:10.590918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.592405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.607965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 250/526] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:10.608683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.634876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.693170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100d041-306e-4c69-a33a-781c61038766 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.713262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd908fc-80b2-46f2-9633-2e91701e59f4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.729482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.730142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.730426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.730709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.731634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:10.731841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.733288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.748752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.749600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.749879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.750123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.756225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 277/527] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:10.756225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.762916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.764414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:10.780973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:10.781945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:23:10.782842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:10.783469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.785090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 251/528] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:10.786025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.870425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b816-2ac4-4b7b-8c50-efc061d6e21c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.874229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:10.892677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417f1b9-f7c7-4e74-9882-fd7f192bd634 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:10.904606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.905285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.905592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.905872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.906667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:10.906977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.908456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.920157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 278/529] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:10.921040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:10.939261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:10.940083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:10.940353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:10.940633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:10.948455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:10.949907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:10.964296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:10.965150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:10.965981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 252/530] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:10.966459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:11.017724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:11.036721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626472b-b545-410b-b0ae-d2b8a4531cf6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:11.074231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:11.075358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.075898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.076365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.077402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=6867f7729ddf465ca6d31df087c00881) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:11.077713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:11.079191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:11.082734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fd61-5a61-4ba5-8abb-1093a960fafa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:11.095124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 279/531] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/role_assignments?user.id=6867f7729ddf465ca6d31df087c00881&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:11.095124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:11.132165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:11.132867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.133227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.133580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.135179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:11.135631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:11.137231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:11.157790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:11.166148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 253/532] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 23 15:23:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:11.166148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:11.239086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ca7c-0d58-44b1-bd18-d7181c1dcaf8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:11.279850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:11.280643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.280928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.281208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.282072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=43d6df3eff264a17a0b970c7fa9eef65) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:11.282389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:11.283900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:11.295190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 280/533] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:11 2022] GET /identity/v3/role_assignments?user.id=43d6df3eff264a17a0b970c7fa9eef65&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:11.295190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:11.310499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:11.312681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4646-d809-43a8-a7ee-029eaf463da2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:11.361971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:11.362645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.362928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.363224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.364368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:11.364678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:11.366411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:11.396423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 254/534] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:11.404578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:11.473609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1873b-a7e6-4f14-a106-f7ed3da2b840 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:11.519830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:11.544553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:11.545268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.545566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.545893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.593177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15165f5a-6720-43fa-bc8f-7b5114c88528 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:11.637172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:11.638640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:11.655807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:11.656437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.656660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.656939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.657845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=2edb5d30e76d488491a9d7c38b3300f6) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:11.658158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:11.659617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cce421-e74a-4a30-b2b5-94dcac015b62 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:11.665974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 255/535] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:11 2022] GET /identity/v3/role_assignments?user.id=2edb5d30e76d488491a9d7c38b3300f6&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:11.694893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:11.750504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad049-f560-42d3-ac90-7c64469ab320 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.750909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad049-f560-42d3-ac90-7c64469ab320 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.751079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad049-f560-42d3-ac90-7c64469ab320 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.752883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 256/536] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:11.758633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:11.759518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:11.759804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:11.778928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:11.780191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:11.888773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 281/537] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:11.894507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:11.910828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 257/538] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:11.935610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.008489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed42d3-5cc8-4cdc-b14e-5819b6c6f520 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.011970 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:12.040661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:12.063855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.064742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.065031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.065307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.076867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754bc5d-941d-4a73-9528-38987efb9b48 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.081324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:12.083747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:12.112987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.113786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.114064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.114335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:12.120690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:12.121509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:12.122752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:12.122752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:12.122752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:12.122752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:12.122752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 282/539] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:12.128512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.130060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:12.137899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:12.138811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:12.140620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 258/540] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:12.148285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.267060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90d8ef-cb80-4597-9215-0fb0dc0502eb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.337852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.338516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.338799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.339071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.342805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:12.343906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:12.345308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:12.351695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd52dd-3333-4ca4-9e71-67088bc2d22f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.370247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 283/541] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:12.377572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:12.379578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.401901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.402579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.402860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.403153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.404190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:12.404506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:12.406021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:12.416180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 259/542] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:12.419571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:12.423509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.517943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ab0f0-2642-4387-9934-8a4093e7b7de None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.555226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.556053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.556335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.556608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.563843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:12.565308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:12.588359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:12.589263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:12.590096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:12.593417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 284/543] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:12.595512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.668280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cc44-2a35-4c02-8d86-ecaf8d98e97f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.736898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.737747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.738033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.738311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.757146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:12.758226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:12.760223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:12.794223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c18f-7fd5-4a73-8f2b-420a7e957109 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:12.798062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:12.800102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:12.802310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:12.802310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:12.802310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:12.802310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:12.802310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 260/544] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:12.808258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.871306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:12.871631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:12.871971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:12.872257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:12.872535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:12.873329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:12.873643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:12.875088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:12.902961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 285/545] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:12.906076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:12.976361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f00e6-3f79-4fe2-bbcc-8adecaae0131 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:13.044611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:13.045193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.045474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.045751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.046482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:13.046788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:13.048182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:13.068384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 261/546] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:13.076145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:13.095972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07249ef-97e5-4f59-a000-50e2af923588 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:13.160864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:13.161860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.162321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.162948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.164002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=2f5e9e3f2475457ba9b307438e5cf97b) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:13.165758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:13.168200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:13.188623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 286/547] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:12 2022] GET /identity/v3/role_assignments?user.id=2f5e9e3f2475457ba9b307438e5cf97b&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:13.223510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:13.247164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc52ee-2418-404f-8a25-55afdd117162 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:13.307656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:13.308489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.308767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.309046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.323796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:13.325260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:13.345824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:13.346806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:13.347758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:13.353526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 262/548] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:13.356226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:13.363995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:13.495987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2bf7-0a11-4600-a151-e4c7a62b0b4a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:13.537132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:13.537806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.538090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.538364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.539239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:13.539550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:13.541536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844ee45-4d24-4279-bb42-f64e6b80a7b4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:13.582461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 287/549] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 23 15:23:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:13.588249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:13.725642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49b3c-8b80-4233-bb77-4b655d4c463a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:13.761393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec461b-a2ce-4d31-9977-8a0d0cb4d7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:13.762051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec461b-a2ce-4d31-9977-8a0d0cb4d7dd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.762524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec461b-a2ce-4d31-9977-8a0d0cb4d7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.762817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec461b-a2ce-4d31-9977-8a0d0cb4d7dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.795477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:13.833130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec461b-a2ce-4d31-9977-8a0d0cb4d7dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:13.834507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec461b-a2ce-4d31-9977-8a0d0cb4d7dd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:13.860380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766955e-e256-4b86-a408-046bd09c9ecb None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.860918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766955e-e256-4b86-a408-046bd09c9ecb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.860918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766955e-e256-4b86-a408-046bd09c9ecb None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.862532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 288/550] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:13.867565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8571-4d6c-4dc3-81d8-7bc933f602f0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.867853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8571-4d6c-4dc3-81d8-7bc933f602f0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.868182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8571-4d6c-4dc3-81d8-7bc933f602f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.885297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-540a8571-4d6c-4dc3-81d8-7bc933f602f0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:13.886483 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-540a8571-4d6c-4dc3-81d8-7bc933f602f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:13.937899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 263/551] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:13.944666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7872af-ffe3-4211-b7c1-281937a81c26 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.945141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7872af-ffe3-4211-b7c1-281937a81c26 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.945568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7872af-ffe3-4211-b7c1-281937a81c26 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:13.947383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 264/552] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:13.951948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7872af-ffe3-4211-b7c1-281937a81c26 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:13.966445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:13.977400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 289/553] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:13.978727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:13.996783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:13.996783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.012506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:14.015193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:14.017179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.082604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7872af-ffe3-4211-b7c1-281937a81c26 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.107199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 290/554] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:14.107199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.146018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.147205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.147649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.148072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.159736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:14.161481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:14.181739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:14.182831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:14.183824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:14.183824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:14.183824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:14.183824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:14.185609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 265/555] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:14.186731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.226071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0442b-cf79-47ab-82d5-449566d0ab03 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.254532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.268157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.269112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.269398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.269684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.282975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:14.293152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:14.294290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:14.295273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:14.299887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 291/556] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:14.301036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.324714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.328003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74bcb-c042-4718-a1ab-a1b30e972bcc None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.364363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.365476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.365945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.366402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.379044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:14.387506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:14.388414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:14.389801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:14.396994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 266/557] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:14.398023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.429686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463bd60-a253-44a5-840e-3b8fb5598e6f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.468573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.469286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.469628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.469911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.470638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:14.470944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:14.472363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:14.485470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 292/558] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:14.487201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.508868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fe15e-635b-48f9-a6ed-2414c401e6a2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.537090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.545440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.546168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.546455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.550372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.550372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:14.550372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:14.550372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2422-aa8d-424f-8622-e7c3251a4d49 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:14.557925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 267/559] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:14.559346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1756-fe0c-4a3a-bd56-10cbd2d91fe9 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.559627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1756-fe0c-4a3a-bd56-10cbd2d91fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.559909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1756-fe0c-4a3a-bd56-10cbd2d91fe9 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.561250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 268/560] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:14.565984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1756-fe0c-4a3a-bd56-10cbd2d91fe9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.592231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.603252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623555-a8ff-4d14-8421-d14480257678 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.644238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.644821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.645103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.645377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.646122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:14.646432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:14.647880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:14.656284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 293/561] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:14.657049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.697386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1756-fe0c-4a3a-bd56-10cbd2d91fe9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.734674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.736209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.736494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.736768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.743613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:14.745039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-e6d67d59-a182-470b-b302-362e20dd23c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:14.758681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:14.759752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:14.760674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 269/562] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:14.761165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.761625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.761625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.770046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d79b2-8bb1-40af-898e-8f7a256ec450 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.773114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.779342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:14.780509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:14.806328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.807182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.807923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.808340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:14.818980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:14.820462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:14.839978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:14.840874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:14.841764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:14.841764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:14.841764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:14.841764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:14.842473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 294/563] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:14.843860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.857976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 270/564] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:14.858884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:14.883642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:14.953447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69d559-911d-469b-998b-7befd49e755a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.982678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873fbf1-01da-4b62-bce4-27c2e3f557a7 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:14.996007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:14.996989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:14.997651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:14.997938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.009312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.010808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.018102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.018754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.019040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.019342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.020141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:15.020450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.021850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:15.030295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:15.031240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:15.032167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:15.032167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:15.032167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:15.032167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:15.038310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 295/565] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:15.038444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 271/566] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:15.038444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.039018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.051585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.110060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.140281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78b2d-353a-464a-969d-27828af68284 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.146522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a9ff-414f-4484-8eb1-d3aee40b7a9f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.178571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.179416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.179706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.180019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.191863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.192517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.192798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.193073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.193789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:15.194096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.194506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:15.195708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:15.203142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:15.204312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 272/567] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:15.205349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.214096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 296/568] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:15.215190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.288820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.318871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa1e89-42e3-4694-b0f1-224b765be0e9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.324748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529481-0bf6-4170-8a9f-e7bf10468291 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.350543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.356335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.357011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.357307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.357591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.358317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:15.358621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.360134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.365854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.366796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.367275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.367730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.369304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c2deaa48dbdb477f971178bd535395a5) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:15.369785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.371526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.374263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 273/569] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:15.375164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.386754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 297/570] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/role_assignments?user.id=c2deaa48dbdb477f971178bd535395a5&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:15.396948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.490010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462f036-9217-4f52-9738-cba3c997c8c4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.528686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.529377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.529660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.529939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.530703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:15.531010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.532553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.546441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 274/571] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:15.547517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.549852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f892f9-bd0d-422d-bbab-e494984f01d6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.583911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.593341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.599963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.599963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.599963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.605060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.606517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.609107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:15.622257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:15.623810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 298/572] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:15.624739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.660359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e10f-2583-482c-96a5-5e18188d8450 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.745383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.746142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.746424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.746699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.754516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.756005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7fe5b298-62e5-432e-8915-8a03dc40657b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:15.770666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:15.771680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:15.772607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 275/573] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:15.773195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519de43-d14e-499d-86a2-03b55ea479a8 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.774088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519de43-d14e-499d-86a2-03b55ea479a8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.774088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519de43-d14e-499d-86a2-03b55ea479a8 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.779280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 276/574] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:15.779280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519de43-d14e-499d-86a2-03b55ea479a8 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.787453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04839f63-85da-4c69-aea7-9904cd6d98c3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.824590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.825382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.825667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.825941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.836732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.838474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:15.856064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:15.856963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:15.857830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:15.857830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:15.857830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:15.857830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:15.857830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 299/575] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:15.858108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:15.902607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519de43-d14e-499d-86a2-03b55ea479a8 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.907714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.918215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:15.938270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:15.938946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.939254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.939531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.940354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:15.940665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:15.942156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c46b-d5c1-4be3-9c90-634c9e77fd88 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:15.963584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 277/576] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:15.963584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:15.963584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:15.963584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:15.970821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abeac1-4df7-44f9-b21b-b4d65bb1b4ed None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:15.978285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:15.979624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:16.008627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.009259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.009555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.009837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.010680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:16.011050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.012508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.034733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 300/577] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:23:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:16.034733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.053054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 278/578] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:16.060180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.151071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5de22b-c580-4901-a1d5-a14805ff89f4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.152832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.169227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6416275-6b0e-48e1-b0f1-5206c7ed3ad4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.171085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.186594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.187296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.187587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.187867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.188595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:16.188908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.190287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.206256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 301/579] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:16.206256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.210039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.210972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.211302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.211573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.222569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.224042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:16.242299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:16.243322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:16.244235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:16.244235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:16.244235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:16.244235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:16.244235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 279/580] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:16.245111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.320969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f06bb-6913-4701-b5d6-42e6c2099d9b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.350326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ef1c-47a0-4657-9d52-2bd42f57632d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.357450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.358255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.358537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.358807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.369328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.370780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.385515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.386309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.386596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.386876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:16.388384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:16.389325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:16.390194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:16.390194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:16.390194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:16.390194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:16.390194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 302/581] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:16.390473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.403862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:16.407223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:16.411687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:16.412609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 280/582] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:16.414030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.431811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.503437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e235f-5240-41a3-b146-ffdb77669c83 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.517372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34800d0-634d-41f9-94ed-ce2f07c3ff09 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.538551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.539394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.539662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.539948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.547631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.549072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.552606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.553271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.553555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.553825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.554542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:16.554846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.556258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:16.563433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:16.564356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:16.565292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 303/583] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:16.565898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.576990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 281/584] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:16.576990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.650094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.651564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.676034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdbfff-6403-4e66-86eb-a2313f210a1c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.676250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b1e27-a846-4528-a1c6-52970876a156 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.709892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.710569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.710898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.711213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.712554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:16.712862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.712970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.713636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.713920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.714193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.714301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.714915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:16.715262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.716706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.722282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 282/585] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:16.723933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.729039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 304/586] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:16.729979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.834694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab76e-587e-4b0f-8839-68e7e1a94852 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.838853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7715b1-e4f5-4aa3-93e3-2fa8761a6adb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:16.874767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.875687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.876033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.876159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:16.876425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.876761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:16.877044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:16.877325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:16.878160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:16.878469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.879085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.879945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.882534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:16.886232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:16.887718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:16.900049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 283/587] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:16.901081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:16.902168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:16.903026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:16.903962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:16.907426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 305/588] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:16.909207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.003539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516812e-f5df-4b4e-9910-142452c17072 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.023349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49533-edbe-4d0c-b4e3-9baa8ba3d525 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.037437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.038311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.038660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.039006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.048825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.050250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.060663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.061586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.061970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.062340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:17.067992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:17.069133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:17.075139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:17.075139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:17.075139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:17.075139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:17.075139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 284/589] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:17.075139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.077039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.078573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:17.093556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:17.094614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:17.095766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:17.096539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 306/590] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:17.097312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.125802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.156082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.182900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb691-0088-403e-bac3-c4e2a183c5c8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.203276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615bd0c-57cb-44e9-918c-14678034ac74 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.219961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.220762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.221043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.221315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.233799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.235287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.249687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.250349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.250631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.250904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.251734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:17.252047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.253503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:17.253657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:17.254472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:17.255408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:17.255408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:17.255408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:17.255408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:17.255408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 285/591] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:17.256208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.271263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 307/592] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:17.271932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.363790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.367449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eddfc-523d-43c1-827d-2fd5d1ebfeb8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.386953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d249f-9a57-4836-b199-3c0697951578 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.402102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.402574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.402870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.403189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.403475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.404215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:17.404522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.405977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.419520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 286/593] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:17.420700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.431743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.432428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.432716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.432995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.433802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:17.434117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.435681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.453718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 308/594] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:17.453718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.531613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12e72-ee74-4bcf-95b7-737544822123 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.562044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf672-e9e1-4453-a08b-0b5c6281e7d1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.570503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.571564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.571848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.572127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.573160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:17.573618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.575291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.589744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 287/595] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:17.590884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.601116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.602969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.603484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.604060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/43d6df3eff264a17a0b970c7fa9eef65/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.610594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.619216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=43d6df3eff264a17a0b970c7fa9eef65, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.620614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.688049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584b74-d4af-4d3b-bd0a-75b9d18b75fb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.721980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.722772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.723054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.723358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.731364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.732786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.734673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 309/596] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:17 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/43d6df3eff264a17a0b970c7fa9eef65/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:17.735554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:17.747688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:17.750926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 288/597] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:17.751896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:17.783685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.841871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:17.869382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbaffd-ce71-4540-9705-ca86a82178e9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.872532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a4a7-4f2c-47c5-ad6b-5609f623d6e7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:17.908728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.909823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:17.910056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.910611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.910715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.911002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.911354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/6867f7729ddf465ca6d31df087c00881/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.911551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.921608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.923678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.929086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=6867f7729ddf465ca6d31df087c00881, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:17.930689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7f69dbd3-4143-49ce-b75f-e4de580b0c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:17.939964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:17.946998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 289/598] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff494-9977-433e-9c45-d463a5b633fc None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:17.947904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff494-9977-433e-9c45-d463a5b633fc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:17.948561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff494-9977-433e-9c45-d463a5b633fc None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:17.948561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 290/599] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:17.948561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff494-9977-433e-9c45-d463a5b633fc None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.037339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 310/600] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:17 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/6867f7729ddf465ca6d31df087c00881/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:18.038325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.060815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff494-9977-433e-9c45-d463a5b633fc None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.113739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.114435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.114721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.115002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.115897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:18.116207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:18.117652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50917e75-41ad-405c-bfeb-6f878ba8e5ce None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:18.134134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:18.155733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 291/601] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 23 15:23:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:18.156699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.156997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.157350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.175303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:18.176567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:18.183122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:18.213700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea003a2-1fb5-4944-a97e-5dbcd02ef21b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.264321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.264987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.265268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.265744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.266539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:18.266854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:18.267991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 292/602] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:18.268341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:18.269094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.283964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 311/603] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:18.289778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.391944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff6db-5de0-489f-85bc-d68a7d32ca6e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.410403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38531-3433-4864-9225-c9ffa16eedc7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.418429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:18.427887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.428683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.431399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.431399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.443122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:18.444871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:18.452547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.453550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.454434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.454817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/2edb5d30e76d488491a9d7c38b3300f6/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.458168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:18.466437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:18.477729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:18.478792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:18.478792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:18.478792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:18.478792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:18.478792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 293/604] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:18.478792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.482426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=2edb5d30e76d488491a9d7c38b3300f6, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:18.483947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:18.583412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 312/605] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:18 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/2edb5d30e76d488491a9d7c38b3300f6/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:23:18.584817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.591297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bda3a-a95d-46aa-bca5-b91b29ca50a9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.632054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.632861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.634961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.634961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.647646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:18.656793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:18.657795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:18.658794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 294/606] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:18.664380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.735477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:18.783363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7438a-51db-4633-a261-9f8bfe37be83 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.832506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.833383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.834313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.834685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.837243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:18.839168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:18.840754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:18.862488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 295/607] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:18.865517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:18.873529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5cad-8ba5-4492-8247-1922615406d9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:18.924050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:18.924799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:18.925225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:18.925602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:18.926804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:18.927246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:18.929070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:18.948657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 313/608] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:18.953960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.031458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:19.034868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a43518-dded-41f4-af2f-a2c0f4b85eb4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.044915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:19.072115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.073113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.073401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.073684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.085007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.087541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:19.114155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:19.121049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:19.122147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:19.122147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:19.122147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:19.122147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:19.129319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 296/609] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:19.134390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.159242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e538-dae9-44a5-9600-143fbe29f882 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.199212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.199212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.199212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.199212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.199647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.201051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:19.216471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:19.217574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:19.218668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 314/610] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:19.225671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.288088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c676-8a19-4a42-8e2f-d65779b571a0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.346718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.347424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.347709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.347983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.348712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:19.349018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.350700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.358620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46d2d-f9dc-4d39-90ab-736895144eaf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.361561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:19.379562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 297/611] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:19.384511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.404384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.405066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.405439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.405723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.406525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:19.406839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.408336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.423490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:19.435204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 315/612] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:19.441368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.498130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53633e4b-dc7f-4c29-b9cd-f976ab5a360e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.546141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.546944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.547255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.547529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.564251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.565681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.568013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ae7f0-a9ba-40fe-9eb1-843e8f617cf7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:19.593329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:19.594294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:19.595243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:19.600166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 298/613] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:19.601033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.614264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.618334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.618334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.618334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/2f5e9e3f2475457ba9b307438e5cf97b/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.643694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=2f5e9e3f2475457ba9b307438e5cf97b, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.645104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.699557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:19.730530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 316/614] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:19 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/2f5e9e3f2475457ba9b307438e5cf97b/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:23:19.737516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbba1-5951-4f51-8f5d-916fe49706d2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:19.785046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:19.785700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:19.785967 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:19.786233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:19.787088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:19.787449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:19.789087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:19.810431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 299/615] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 23 15:23:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:19.818206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:19.856616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:19.981967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a158-b039-4a17-9a37-bce70f595ef5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.022631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.023498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.023782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.024059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.035800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:20.037522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d7d0f7c7-76f8-42eb-9b58-317ad77d5b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:20.064499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:20.065994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:20.066865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:20.066865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:20.066865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:20.066865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:20.068883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 317/616] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:20.074943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.220210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee83a6-35c3-4044-b873-0d0522dadf7a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.236921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3150c-63a8-4e24-a9b7-36c0dbe850f0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.237547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3150c-63a8-4e24-a9b7-36c0dbe850f0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.238022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3150c-63a8-4e24-a9b7-36c0dbe850f0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.240125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 318/617] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:20.246175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.246755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.247259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.257234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:20.269413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.278686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:20.278828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.278828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.278828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.278828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:20.278828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:20.278828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:20.279301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:20.304413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 300/618] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:20.309781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.394753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:20.405725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 319/619] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:20.434994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.508567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201559d0-9e13-45cb-995a-6f82ae2354f7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.569875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.570698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.570990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.571337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.579046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:20.580516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:20.593687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7b85-eb50-41ee-bc44-73a443a82674 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0b330fb9-2713-4448-8965-2f43168b7cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:20.596529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:20.597403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:20.598279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 301/620] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:20.599910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945cf29-f432-45b1-9c0c-0f6db95f9fa4 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.600087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945cf29-f432-45b1-9c0c-0f6db95f9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.603201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945cf29-f432-45b1-9c0c-0f6db95f9fa4 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.606452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 302/621] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:20.607278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945cf29-f432-45b1-9c0c-0f6db95f9fa4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.629416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8473a-a4f6-4d54-acb4-9e8d3f1b525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.630249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8473a-a4f6-4d54-acb4-9e8d3f1b525b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.630533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8473a-a4f6-4d54-acb4-9e8d3f1b525b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.630807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8473a-a4f6-4d54-acb4-9e8d3f1b525b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.644134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8473a-a4f6-4d54-acb4-9e8d3f1b525b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-82f8473a-a4f6-4d54-acb4-9e8d3f1b525b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:20.653931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:20.656895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 320/622] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:20.657903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.658812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.658812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.667559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:20.679339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:20.680551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:20.726026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945cf29-f432-45b1-9c0c-0f6db95f9fa4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.733517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:20.750281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 321/623] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:20.751297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.783073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.783825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.784120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.784407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.785450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:20.785772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:20.791536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:20.808637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 303/624] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:20.809603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.868099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cce34-9b48-47cf-9eb2-4f53e5aab358 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.905574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.906354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.906645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.906925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:20.907715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:20.908028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:20.909674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:20.920871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 322/625] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:20.921681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:20.936127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81256c22-7990-4c96-8c08-51351b9c46cd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:20.952767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:20.978561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:20.987035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:20.988378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:20.988783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:20.989072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.003469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:21.013634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:21.015262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:21.016761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:21.023129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 304/626] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:21.023129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.046239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48ddb-3d3a-41c5-b94f-4d525a685528 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.096495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.098247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.098537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.098820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c2deaa48dbdb477f971178bd535395a5/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.116971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=c2deaa48dbdb477f971178bd535395a5, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.118864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.135320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10a8f9-0b8b-4f75-a5f4-17049681877c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.171584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.172438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.172729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.173009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.186657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.188086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.205329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 323/627] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:20 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c2deaa48dbdb477f971178bd535395a5/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:21.206769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:21.209084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:21.214576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:21.215698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:21.215698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:21.215698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:21.215698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:21.215698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 305/628] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:21.216629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.271185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:21.342140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:21.347304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f054-dc68-43a4-b332-9a3829e24979 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.393153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.394585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.395089 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.395588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.397430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:21.397966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.400153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed9b37-f4d7-4ebd-b51c-af99432c0ae3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.411680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 324/629] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:21.423148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bab27-187c-4cda-937c-3b388035d06d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.423339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bab27-187c-4cda-937c-3b388035d06d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.423518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bab27-187c-4cda-937c-3b388035d06d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.425168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 325/630] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:21.425917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bab27-187c-4cda-937c-3b388035d06d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.460594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8c886-28b6-4001-99c2-bb62383512a3 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.501469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.501469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.501788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.502035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.502765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:21.503075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.504480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab84bc6-f663-4d9d-969e-ce0d68c33cdf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.518559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 306/631] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:21.519779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.520070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.520351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.537789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:21.538972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:21.570879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bab27-187c-4cda-937c-3b388035d06d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.614686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.615927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.616473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.616756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.630605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.631228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 307/632] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:21.632104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.632215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:21.652036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:21.653274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:21.654456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:21.654456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:21.654456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:21.654456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:21.654456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 326/633] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:21.661293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:21.663373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.680225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:21.756246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cebee-8e6f-4d63-8880-c25b3399e5c4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.772113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bf170-5624-4625-9f3b-346d05219730 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.793736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.794919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.795465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.795934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.804114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.806023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.810264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.810936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.811412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.811711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.812458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:21.812772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.814219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:21.824354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:21.825370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:23:21.826318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:21.829002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 308/635] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:21.829974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.833069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 327/635] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:21.837647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:21.911190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:21.913131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:21.941562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904567-adc9-4b0d-8bd2-2dbe295b8529 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.945960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29b343-ec39-4f14-9b3f-d48f11865975 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:21.979541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.980240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.980529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.980815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:21.981694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:21.982011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:21.983957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:21.985416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:21.986360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:21.986650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:21.987035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.000053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:22.008222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:22.009778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:22.011383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 309/637] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:22.013011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 328/637] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 23 15:23:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:22.013154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.013296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.117533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ab098-67c6-4913-8374-8b5336b30c97 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.126803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47d1b6-894b-4b8e-a036-9201b9fbd5ae None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.149131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.155208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996aba8-04b5-45d8-a6f2-c751295450c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.155879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996aba8-04b5-45d8-a6f2-c751295450c3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.156167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996aba8-04b5-45d8-a6f2-c751295450c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.156442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996aba8-04b5-45d8-a6f2-c751295450c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.163333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.167358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.168362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.168796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.169239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.177420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.179049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:22.193784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:22.194759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:22.195728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 310/638] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:22.197264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.238506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996aba8-04b5-45d8-a6f2-c751295450c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.240131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996aba8-04b5-45d8-a6f2-c751295450c3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.309603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb09d8-7976-492f-bc43-3b8a1d61f9a1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.345456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 329/639] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:22.345456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b19a8-c045-4f4d-b698-43aa6c674e64 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.345456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b19a8-c045-4f4d-b698-43aa6c674e64 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.345456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b19a8-c045-4f4d-b698-43aa6c674e64 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.345456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 330/640] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:22.345456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b19a8-c045-4f4d-b698-43aa6c674e64 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.349941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.350943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.351072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.351336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.352095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:22.352491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.353855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.366782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 311/641] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:22.366782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.381901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.426889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.454371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b19a8-c045-4f4d-b698-43aa6c674e64 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.481643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4210c7-5f8a-44fb-a17e-a95d36df889e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.490652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.491393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.491952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.491952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.492768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:22.493889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.495215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333f7b3-258d-4473-8e03-7e2d1c3d68b6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.514558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 331/642] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:22.515816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.516102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.516377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.524165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.524966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.525252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.525530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.533329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:22.534508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:22.536732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.538165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:22.557114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:22.558262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:22.559618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:22.559618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:22.559618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:22.559618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:22.559618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 312/643] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:22.559618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.606633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 332/644] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:22.607691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.640472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.677858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54e774-33b2-44a7-9421-d6878546fab4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.685874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.714139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.715111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.715407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.715689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.723718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308fc99-2e71-4ec6-936c-07e438e70270 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.726028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.728007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:22.746483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:22.747580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:22.748816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:22.748816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:22.748816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:22.748816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:22.748816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 313/645] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:22.748816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.764135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.765108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.765532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.765947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.837639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.839390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.853222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957d9e-883f-4b62-b960-ab332a9b0443 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:22.858505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.888650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:22.889320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:22.889610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:22.889890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:22.890625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:22.890936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:22.892332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:22.907006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 314/646] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:22.907927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:22.928707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:22.957322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 333/647] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:22.958187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.016817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980978df-baf4-4360-a102-96ea65a592fa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.052071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.053210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.053689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.054108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.063346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296dad3-1311-4008-92fa-a3c4fbb8c87b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.065045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:23.072996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:23.074120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:23.075169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:23.076400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 315/648] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:23.077194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.088710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.107190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013048-58af-468b-9588-6abb85a58630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.107805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013048-58af-468b-9588-6abb85a58630 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.108091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013048-58af-468b-9588-6abb85a58630 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.108374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013048-58af-468b-9588-6abb85a58630 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.109151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04013048-58af-468b-9588-6abb85a58630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:23.109458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04013048-58af-468b-9588-6abb85a58630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.111002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04013048-58af-468b-9588-6abb85a58630 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.128333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 334/649] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:23.129242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013048-58af-468b-9588-6abb85a58630 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.169282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.194639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f462f-7b34-44a2-8070-2d8fa94b6f03 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.239088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.240010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.240299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.240871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.243148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013048-58af-468b-9588-6abb85a58630 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.249484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.250971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:23.271812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:23.272803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:23.273703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:23.278926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 316/650] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:23.279815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.281272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.282078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.282359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.282833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.295564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.297014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:23.315884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:23.316832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:23.317723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:23.317723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:23.317723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:23.317723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:23.317723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 335/651] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:23.318438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.350033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.386948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacb407-978e-400e-bc29-836a36731a37 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.421057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.421744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.422023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.422296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.422609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0be4f8-2e7e-4675-8acd-4dcd81343347 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.423058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:23.423520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.424919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.431811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.440447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 317/652] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:23.440447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.469512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.470322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.470511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.470787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.478616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.480113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:23.494563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:23.495919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 336/653] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:23.496855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.559413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69178954-d5e1-4f85-b7aa-c47c2caee7b3 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.596307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.601461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.602135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.602458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.602740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.603563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:23.603880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.605306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.606823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db88d-6792-4fa2-a536-cc5f2d23830d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.619246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 318/654] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:23.620390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.645819 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.646482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.646768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.647043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.647850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:23.648159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.649556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.660496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 337/655] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:23.661282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.678812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.719383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472519e-21b8-45e7-824d-236b6766f54f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.752159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.752945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.753301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.753503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.763285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ea368-0a07-4df5-899d-27c6ca530840 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.764378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.765827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8fdeb074-f60b-4041-bf4d-e3d8c00e19de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:23.782441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:23.783419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:23.784290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:23.784290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:23.784290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:23.784290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:23.784290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 319/656] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:23.784908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214c7-4cf8-4dc6-ae43-f29354801f6f None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.785198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214c7-4cf8-4dc6-ae43-f29354801f6f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.785478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214c7-4cf8-4dc6-ae43-f29354801f6f None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.786737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 320/657] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:23.787451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214c7-4cf8-4dc6-ae43-f29354801f6f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.799691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.800359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.800638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.800913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.801749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:23.802060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.803520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.821656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 338/658] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:23.822721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.832545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.896701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214c7-4cf8-4dc6-ae43-f29354801f6f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.912542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:23.921955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d75ac7-432e-4841-b018-f52d57818ec7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:23.938438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.939115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.939402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.939680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.940518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=43d6df3eff264a17a0b970c7fa9eef65) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:23.940832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.942259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.948235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 321/659] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/role_assignments?user.id=43d6df3eff264a17a0b970c7fa9eef65&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:23.949028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:23.960119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:23.960941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.961226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.961506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:23.969537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:23.971042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4035951d-c526-48a9-8bec-1b09e57686ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:23.986800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:23.987975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:23.988857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 339/660] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:23.989343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:23.989870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:23.989971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.010113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:24.011288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:24.078238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36a97-431c-4c91-adf5-040c0b57537c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.081273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:24.095124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 340/661] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:24.095124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.133013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.133735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.134021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.134306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.135059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:24.135401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.136811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.151187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 322/662] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:24.152375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.199219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:24.278585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029d847-ecc5-44ee-9ded-8c74c084859e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.317058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.317745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.318009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.318290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.319078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:24.319418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.319586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440802-f7df-4f44-81b6-4c507e964d39 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.320860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.337621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 323/663] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:24.337621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.360658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.361315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.361594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.361868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.429086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:24.432898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.434326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.443665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:24.449513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b4c7-e9ad-4fc0-a392-c9ca64ef602b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.484774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.485585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.485868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.486143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.497408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:24.505137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:24.506055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:24.506895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 324/664] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:24.507618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.548344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 341/665] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:24.548956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.620280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf4d38-9b2c-452d-87af-af7e112df77d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.649330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:24.652829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff3dc-2b13-408f-83c4-4550935a1eaa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.659524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.660531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.661010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.661457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.669708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.671423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.686290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.686944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.687256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:24.687566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:24.688692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:23:24.689832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:24.690492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.690492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=6867f7729ddf465ca6d31df087c00881) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:24.690492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.690492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.692947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 325/666] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:24.693997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.701551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 342/667] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/role_assignments?user.id=6867f7729ddf465ca6d31df087c00881&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:24.702523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.722978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:24.827683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4e5ad-d73a-4313-a9a1-0b2f892b4dc6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.837026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61928d06-cc0b-4d0b-b4bc-9d0ed8010506 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:24.867686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.869220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.869598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.869968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.881357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.883007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.884935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:24.886006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:24.886821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:24.887280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:24.888200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:24.888682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:24.890235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:24.901258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 326/668] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:24.902342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:24.903535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:24.904617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:24.905707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:24.905707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:24.905707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:24.905707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:24.907371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 343/669] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:24.908302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:24.928468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.009198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.036668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309a0b-4222-4def-81d6-a7c98f4c0912 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.038254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a83e-51d8-4052-b708-2b161fb18092 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.075432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.076109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.076396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.076588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.076718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.077428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.077544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:25.077760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.077865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.078027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.079241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.090731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.092223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.103895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 327/670] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:25.104791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:25.112173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:25.113059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:25.113942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:25.113942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:25.113942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:25.113942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:25.114161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 344/671] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:25.117736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.206286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.214119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56d740-3b28-4534-95f9-ea1150c76caa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.266576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136ecc8-609a-419e-ae13-92c02d296ed4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.269507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.271012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.271336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.271619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.272363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:25.272678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.274057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.277179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.294783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 328/672] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:25.296337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.311721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.313062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.313782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.314242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.405954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.408689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.420601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c5626-7b7d-42f7-9b93-36c71c6b3de4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.455710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.456237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.456519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.456794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.457512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:25.457851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.459232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.471599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 329/673] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:25.472471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.496411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.532916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.534337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 345/674] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:25.535417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.581021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160aef-7db9-44e5-b318-07372ddc2237 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.621009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.622157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.622362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.622638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.632148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.634063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:25.651173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:25.652171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:25.653158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 330/675] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:25.653656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828ef8-fb64-42e6-bf2e-bd954d4980d5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.693090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.694263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.694749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.695261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.703003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.704829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:25.719718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:25.720681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:25.721606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:25.724220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 346/676] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:25.725485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.754178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.762906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366eb8-d633-4fa1-adf6-a4b12eab28b5 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.780505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:25.803124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.803929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.804211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.804483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.816582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.818027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.831829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306c8b6-000c-491f-9c83-0f3b1630ab3f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:25.837726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:25.838755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:25.839676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:25.839676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:25.839676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:25.839676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:25.839676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 331/677] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:25.840373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.872471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:25.873501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:25.874055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:25.874529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:25.875571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:25.876082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:25.877731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:25.890212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 347/678] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:25.891328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:25.989188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.005553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b0d3b-fbe1-4f2c-b5f8-02cc1e954ad5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.046103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.047216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.047735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.048218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.049175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:26.049687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.051341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.064220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 348/679] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:26.065383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.085465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6d61-f17d-4121-955e-305db96e0d02 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.124999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.125700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.125980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.126282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.127159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:26.127474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.129081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.151282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 332/680] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 23 15:23:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:26.152686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.175687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983861-b2ba-42b2-9826-db649534ae14 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.182992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.210895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.212502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.212991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.213481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.214512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=2edb5d30e76d488491a9d7c38b3300f6) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:26.215025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.216705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.223298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 349/681] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/role_assignments?user.id=2edb5d30e76d488491a9d7c38b3300f6&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:26.224692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.243697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.273824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a29aa-6c98-421f-bece-11d3746364f1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.314218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.315241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.315525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.315797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.324239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.325825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.341744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee74f6-606a-44d9-8c5d-3483938de910 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:26.341941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:26.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:26.343712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 333/682] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:26.348733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.381223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860195ef-d8a8-4655-95c4-eb959b58275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.382313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860195ef-d8a8-4655-95c4-eb959b58275f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.382865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860195ef-d8a8-4655-95c4-eb959b58275f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.383911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860195ef-d8a8-4655-95c4-eb959b58275f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.447759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.461585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860195ef-d8a8-4655-95c4-eb959b58275f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.464453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860195ef-d8a8-4655-95c4-eb959b58275f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.464791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b191d2-f037-4bb6-a5ed-b49bc4d498b9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.476535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.507948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.508565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.508848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.509127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.510463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:26.510778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.512236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482a510-371e-448b-acd7-aed24e480b59 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.528412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 334/683] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:26.529577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f176-34ff-4933-9314-2054c5fca78a None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.529868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f176-34ff-4933-9314-2054c5fca78a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.530148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f176-34ff-4933-9314-2054c5fca78a None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.531665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 335/684] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:26.533677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f176-34ff-4933-9314-2054c5fca78a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.591843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 350/685] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:26.593167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.593456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.593728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.615428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:26.616656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:26.671949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f176-34ff-4933-9314-2054c5fca78a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.691140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 351/686] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:26.700139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.720074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.721089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.721626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.722094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.723203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=2f5e9e3f2475457ba9b307438e5cf97b) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:26.725245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.726927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.737742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 336/687] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/role_assignments?user.id=2f5e9e3f2475457ba9b307438e5cf97b&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:26.739206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:26.763575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.781024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:26.876189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e4a98-7fa5-492f-b4a9-087c63abc56b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.938972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:26.939824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:26.940172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:26.940375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:26.959577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0bcb-e003-4708-b35e-bff90ea0287e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:26.964568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:26.966056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:26.995149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:26.996077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:26.996965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:26.996965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:26.996965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:26.996965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:27.001613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 352/688] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:27.001919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.027225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.028483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.028995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.030018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.051800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.054583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:27.079147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:27.080090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:27.080986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:27.080986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:27.080986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:27.080986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:27.083717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 337/689] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:27.089822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.130683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:27.141281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78b31b-1e30-417f-b31f-c81c719b057d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.179838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:27.181509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.182255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.182601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.182945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.183776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:27.184148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.185594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.198771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 353/690] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:27.203999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.241052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa0bd3-cb36-49ff-af45-c599604dcb7e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.282641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.283270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.283529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.283810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.284542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:27.284853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.286221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10779-8e93-4759-a07c-884ea1b22812 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.298987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 338/691] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:27.300461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c2a5-5900-4321-a2ac-12d0bcc79dc9 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.300750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c2a5-5900-4321-a2ac-12d0bcc79dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.301031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c2a5-5900-4321-a2ac-12d0bcc79dc9 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.307029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 339/692] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:27.307863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c2a5-5900-4321-a2ac-12d0bcc79dc9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.341035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa4d4b-a4b2-4e08-a46a-06d706615aa9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.386489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.387326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.387608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.387885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.395595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.397066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d54ede7e-4797-4df1-9fd3-434c503f3dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:27.411467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:27.413491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 354/693] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40861-8693-4680-b553-abdb783b0338 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.415656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40861-8693-4680-b553-abdb783b0338 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.417050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40861-8693-4680-b553-abdb783b0338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.422345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c2a5-5900-4321-a2ac-12d0bcc79dc9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.434653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-93d40861-8693-4680-b553-abdb783b0338 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:27.436039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-93d40861-8693-4680-b553-abdb783b0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:27.444796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:27.451496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:27.466461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.467449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.467930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.468504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.469661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.471960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.509782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 355/694] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:27.515936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40861-8693-4680-b553-abdb783b0338 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.599755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 340/695] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:23:27 2022] POST /identity/v3/users => generated 254 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:27.601443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.638768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40861-8693-4680-b553-abdb783b0338 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.688537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.690556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.690854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.691162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.691979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:27.692292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.693773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.729067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 356/696] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:27.732132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.738099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:27.839448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1fb47-9c17-49fc-a20b-52d6ea4ad318 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.877293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466f5d2-adfc-4d74-a5ce-0dbce5f93793 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:27.884562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.885611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.886160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.886645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.899842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:27.908356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:27.909284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:27.910164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:27.913061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 341/697] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:27.919548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:27.920688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:27.921354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:27.921642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:27.921923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:27.922764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c2deaa48dbdb477f971178bd535395a5) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:27.923082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:27.925459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:27.934941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 357/698] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/role_assignments?user.id=c2deaa48dbdb477f971178bd535395a5&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:27.970113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:28.042335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34ee9-ffa4-4b41-9612-eac923afde68 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:28.086176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:28.086918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.087225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.087499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.088650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:28.088650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:28.089895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:28.104252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 342/699] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:28.109794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:28.187739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:28.223179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c93bf-c51b-46c9-a629-3a29f3993c76 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:28.266673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:28.267525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.267813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.268090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.280018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:28.281498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:28.299911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:28.300850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:28.301760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:28.301760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:28.301760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:28.301760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:28.305834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 358/700] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:28.308227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:28.417608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:28.421175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c10c-75ca-4fa0-9dc7-576d52de25a1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:28.457262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:28.457865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.458157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.458444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.459214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:28.459532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:28.460925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:28.478938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 343/701] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:28.480329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:28.595722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d48cdc-aff7-413e-aa01-9ad3b5de5339 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:28.618735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:28.637019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:28.638135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.638662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.639149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.649122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:28.650872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6efb188c-33b7-4eda-aa49-583b2d7a4927 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:28.666352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:28.672336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:28.673376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:28.674170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 359/702] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:23:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:28.677036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:28.789455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504dc3-714c-4dd9-b680-48047287105c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.790288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504dc3-714c-4dd9-b680-48047287105c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.790585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504dc3-714c-4dd9-b680-48047287105c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.792197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 360/703] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:28.797438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.797730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.798015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.802280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeb77b-2138-41b7-8cde-5f533b3f885e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:28.829679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:28.835285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:28.864927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:28.867822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:28.868342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:28.868880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:28.871395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:28.871923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:28.874401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:28.915406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 344/704] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:23:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:28.918901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:28.956925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:28.969456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 361/705] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:29.006797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:29.076986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253941-4e8e-491a-b071-74a1e32f4041 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.113528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.114533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.115025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.115574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.135193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5947d-3a83-4d8f-98e0-1aae8ac339ef None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.146093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:29.186700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.187784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.188218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.188660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.189465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.189584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.191067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:29.191201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:29.215519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:29.224619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:29.225661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:29.226470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:29.235912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 362/706] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 23 15:23:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:29.248126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:29.313619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 345/707] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:23:29.315204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:29.428271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7113-d4d5-4950-8e30-f78349a7944e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.451484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:29.463735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc811-4be2-45a5-a28a-e0c5bd3aeb9a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.478513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.479629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.480067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.480461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.500382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.501842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:29.512793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.513470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.513756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.514032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.514754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:29.515137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.516526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:29.531081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 363/708] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 23 15:23:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:29.534106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:29.534978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:29.535891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:29.535891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:29.535891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:29.535891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:29.536518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:29.543585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 346/709] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:29.550156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:29.593373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:29.669721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0256e-8038-43a7-ac46-8a9eebd7cf06 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.719897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8c7b-4743-402b-9d51-39a8dd041168 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.721241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.722199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.722586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.723770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.724853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:29.725266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.726755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb12c16-0258-48d1-a6b0-3944e6b37310 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:29.734506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 364/710] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 23 15:23:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:29.736234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb902dc-0c47-4b54-aa63-d1491844b624 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.736635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb902dc-0c47-4b54-aa63-d1491844b624 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.737023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb902dc-0c47-4b54-aa63-d1491844b624 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.743282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 365/711] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:29.747414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.747668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.747903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.769581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.770679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.771198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.771737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.773060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:29.773599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.775329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:29.791662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 347/712] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:29.796263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:29.797349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:29.797477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:29.837762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:29.921718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486313a9-01dd-4465-994e-10fdbf79854c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:29.963586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:29.964790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:29.965275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:29.965769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:29.975473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:29.977830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:30.000288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:30.001332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:30.002267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 348/713] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:30.007578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.037604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 366/714] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:30.061399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.093667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:30.107875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:30.118440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41417cc-00cf-44bc-b62e-6da14dc8d110 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:30.153612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:30.154283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.154579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.154853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.155736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:30.156289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:30.157661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:30.170985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 349/715] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:30.178069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.198839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43ec6b-3099-450d-abee-89df6f07a6c8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:30.278442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:30.279272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.279559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.279840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] PATH_INFO: `/v3/services/network` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.280507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:30.281899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:30.312658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:30.313766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:30.314633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:30.316947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 367/716] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:30.323246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.362072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb8614-826b-4263-9972-2effe58900aa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:30.397769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:30.398437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.398765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.399618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.400465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=6867f7729ddf465ca6d31df087c00881) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:30.400781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:30.402213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2efe21-1572-4d29-a218-8532831bc219 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:30.408589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 350/717] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/role_assignments?user.id=6867f7729ddf465ca6d31df087c00881&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:30.497249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f946-8284-4438-b823-0f1df6076662 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.497451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f946-8284-4438-b823-0f1df6076662 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.497728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f946-8284-4438-b823-0f1df6076662 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.499409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 351/718] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:30.509030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.509314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.509593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.514251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:30.530102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37064c-b3c0-4dbe-b77e-de7ca0e3b923 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:30.548309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:30.549554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:30.570162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:30.583945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:30.584639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.584936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.585200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.585927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] RBAC: Adding query filter params (name=network) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:30.586235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:30.588227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:30.595686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 368/719] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:30.599759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.642372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 352/720] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:30.681239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.778079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce9cb-cdf3-412b-baf5-bd9b08305808 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:30.804976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fc2d0-0f82-4664-86f6-436c136dfcf8 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:30.853239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:30.853943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.854231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.854509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.855279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] RBAC: Adding query filter params (type=network) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:30.855593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:30.857035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:30.872005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 369/721] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:30.878569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:30.879455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:30.879742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:30.880023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:30.892465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:30.900444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:30.901491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:30.902348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 353/722] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:30.908265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:30.951661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:31.040936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba3a31-b348-4d07-b723-5804169fb781 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:31.084438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:31.085130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.085413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.085687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.086979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:31.087314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:31.088690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff37743-8150-44ba-925e-4e2d4aa02d7b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:31.099007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 370/723] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:31.104416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.108571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:31.116385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a497-a476-4549-9d4f-2fc32c520b9c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.116665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a497-a476-4549-9d4f-2fc32c520b9c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.116945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a497-a476-4549-9d4f-2fc32c520b9c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.119057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 371/724] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:31.124215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.124505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.124785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.144558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:31.145737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:31.247752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7086a1-a6d9-4cd5-aafa-2b1fa9b237bb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:31.268466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 372/725] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:23:31.278071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:31.278900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.279217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.279551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.291273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:31.292667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:31.298869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:31.314207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:31.315198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:31.316098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:31.316098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:31.316098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:31.316098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:31.323118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 354/726] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:31.323118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.336858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:31.391509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:31.437859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad2a84-f9d6-4749-990e-1c2cc899d9fd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:31.474839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:31.475615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.475910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.476240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.476992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:31.477835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:31.479229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:31.497155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 355/727] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:31.498947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.607675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a677d7c-c11a-45dc-aa9e-e5f753920ae1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:31.627411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:31.647745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:31.648689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.649036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.649331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.657244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:31.658875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:31.661366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998433bc-5064-4b88-9900-fdc1f0aeb10b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:31.676951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:31.677899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:31.678835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:31.683568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 356/728] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:31.684969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.785115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:31.785929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.786217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.786498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.809918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d27b4a-004c-4e19-8b87-8aa528e68086 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:31.814186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:31.829430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:31.830609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:31.831683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:31.837559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 373/729] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 539 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:31.843006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.884923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:31.885535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:31.885821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:31.886097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:31.886958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:31.888536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:31.890005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:31.937666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 357/730] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:31.951800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:31.999621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.021475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.024692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1957c-65ed-469c-b980-d92b7d775716 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.062701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.065328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.065328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.065328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.065328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:32.065670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.067042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.077299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 374/731] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:32.082462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:32.186587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abef1b-b57e-4c73-8d8a-e5af2335a50e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.188816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635886cc-d834-4a55-a6f5-fe27233b35de None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.239106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.239932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.240218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.240497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.245476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.256457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.257950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:32.290123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:32.291083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:32.291981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:32.291981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:32.291981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:32.291981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:32.292210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.292764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.292865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.294139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.302699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 375/732] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:32.306302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:32.416095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.417696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.475537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.509544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a35ab-c508-4a8e-9bb2-5d0d80da798a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.548684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.549357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.549647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.549928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.550657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:32.551028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.552621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94fdfa-d689-4202-b0c4-55d3d13b0b7d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.566601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 376/733] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:32.568019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3f39-3023-4b74-a0bc-0db904bee52c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.568375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3f39-3023-4b74-a0bc-0db904bee52c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.568667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3f39-3023-4b74-a0bc-0db904bee52c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.569387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 358/734] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:32.573241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:32.575153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 377/735] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:32.577370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3f39-3023-4b74-a0bc-0db904bee52c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:32.646300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.689404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937662b-0ebe-4a62-b9b9-6356b290580d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.719304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3f39-3023-4b74-a0bc-0db904bee52c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.736957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.738716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.739245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.739733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.742446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.752784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.754972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.758913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.758913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.758913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.758913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.771314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.772973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0b0bab38-8692-4844-abbf-4b2300b8cfd9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:32.776151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:32.777325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:32.778505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:32.781749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 359/736] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:32.783488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.783947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.784360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:32.803298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:32.804803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:32.805960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:32.805960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:32.805960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:32.805960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:32.811487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 378/737] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:32.811487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:32.813114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:32.814313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:32.911365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 360/738] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:32.912324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:32.928140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:32.932970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad040929-4cac-4f5c-99ef-666d55a27924 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:32.974193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:32.975291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:32.975582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:32.975864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:32.976721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:32.977065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:32.978511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:32.999254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 379/739] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 23 15:23:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:32.999254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.032122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267998be-85cc-4521-9583-9a8de91d6395 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.060051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.071658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.072336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.072632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.072897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.073632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:33.073935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.075320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d6f4e-fc5d-4184-bb5c-1766db98d452 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.087936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 361/740] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:33.089857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4e39-8f98-49dc-b86a-df0699e31aab None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.090596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4e39-8f98-49dc-b86a-df0699e31aab None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.091170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4e39-8f98-49dc-b86a-df0699e31aab None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.093018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 362/741] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:33.094233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4e39-8f98-49dc-b86a-df0699e31aab None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.113340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125c64-b2f6-4a2f-aadf-82857ca1d829 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.155676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.156640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.157101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.157588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.158494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.159966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.199119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4e39-8f98-49dc-b86a-df0699e31aab None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.235699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a080-ba7c-416c-b11d-cb04cde973b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.236389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a080-ba7c-416c-b11d-cb04cde973b0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.236672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a080-ba7c-416c-b11d-cb04cde973b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.236946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a080-ba7c-416c-b11d-cb04cde973b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.261832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 380/742] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:23:32 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:33.263394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.294640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.299511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.313634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a080-ba7c-416c-b11d-cb04cde973b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.315332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a080-ba7c-416c-b11d-cb04cde973b0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.426931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e486c-2009-48ae-a601-f9cc5c047731 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.461312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 363/743] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:23:33.463365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.463655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.463936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.465001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.465793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.466073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.466347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.474850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.476369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.483005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:33.484566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-cc3b1238-9574-49fc-988f-4aaa528c9a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:33.491167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:33.492039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:33.493498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 381/744] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:33.494442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fb27-270e-4f98-a37f-7463af40d899 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.494549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fb27-270e-4f98-a37f-7463af40d899 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.495128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fb27-270e-4f98-a37f-7463af40d899 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.496335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 382/745] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:33.497904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fb27-270e-4f98-a37f-7463af40d899 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.559897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 364/746] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:33.560663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.575901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.598817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.628819 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fb27-270e-4f98-a37f-7463af40d899 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.664036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.665437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.665720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.665994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.673349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b681-94e2-4629-adfb-528afead8632 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.677985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.679816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a28c40aa-79fb-4b43-9cd1-814010113642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:33.698333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:33.699348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:33.700243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:33.700243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:33.700243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:33.700243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:33.700243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 383/747] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:33.701069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.701244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.701530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.717645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.718308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.718591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.718864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.719039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:33.719704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:33.720011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.720442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:33.721465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.734131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 365/748] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:33.734827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.803252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 384/749] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:23:33.804121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.822762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.850199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3e67f-c3ff-4ec5-a898-f5ec3e4c8828 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.864786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:33.886414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.887254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.887543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.887825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.898351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:33.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:33.907317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:33.908192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 366/750] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:33.908892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:33.918142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857157f-eee4-4837-9abc-f6b5d9d80489 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:33.953696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:33.954671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:33.955117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:33.955627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:33.956520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:33.956973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:33.958740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:33.971026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 385/751] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:33.972066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.041501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53934b-cc91-4e02-9dfc-00d030016a1e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.075208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.075797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.076105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.076365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.077202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c9bdcccb57d14f44a4f93ced180dca4b) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:34.077521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.078947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.080803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.083246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5159e-8bdc-4527-85a9-cd3eec267930 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.087142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 367/752] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:33 2022] GET /identity/v3/role_assignments?user.id=c9bdcccb57d14f44a4f93ced180dca4b&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:34.087142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.112570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.139445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.140804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.141335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.142007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.143498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.145625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.202695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fa0f-9e98-4669-9fd2-6241ddc41f2e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.243608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 386/753] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:23:33 2022] POST /identity/v3/services => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:34.244683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.265137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.266206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.266750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.267291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.268373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:34.268908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.270708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.287818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 368/754] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:34.290303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.368344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.426386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d506-6d06-4e73-98b9-ced78d0e8810 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.470366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.472001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.472484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.472981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.481660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852db9-7984-4d89-88e1-2d3f4575e7df None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.486027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.487803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:34.506510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:34.507487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:34.508396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:34.508396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:34.508396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:34.508396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:34.510614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 369/755] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:34.516958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.518762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.519648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.519937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.520215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.527874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.529756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:34.545114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:34.546026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:34.546976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 387/756] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:34.554635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.592959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.641738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f071-aba2-4008-af15-01c2f74df1a8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.651570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.661746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861485b3-70c9-4733-8f19-60881fb38c73 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.682440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.683528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.684010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.684529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.685471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:34.685972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.687789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.700452 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.701122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.705718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.705718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.705718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:34.705718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.705987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 370/757] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:34.706069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.709286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.717961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 388/758] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:34.733374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.823846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460dbaa-4b27-4095-8443-cb347cb8065f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.861189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.862381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.862972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.863462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.871987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.873789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:34.890068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:34.891034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:34.892044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:34.894743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 371/759] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:34.899549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.902150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:34.906782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796669e6-93d4-4eeb-abef-24d5873ed3aa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:34.933078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:34.954131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:34.954798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:34.955104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:34.955529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:34.956353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c2deaa48dbdb477f971178bd535395a5) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:34.956903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:34.958114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:34.971301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 389/760] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/role_assignments?user.id=c2deaa48dbdb477f971178bd535395a5&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:35.020891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521756f2-d003-4567-8043-1fea253ef441 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:35.062606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:35.063689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.064178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.064657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.065750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:35.066281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:35.067983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:35.089714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 372/761] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:23:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:35.095658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:35.228919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4781fb-fd45-438a-8b1c-5c17dbcef79f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:35.265434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:35.266237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.266528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.266810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.277563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:35.279113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:35.298442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:35.299387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:35.300264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:35.300264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:35.300264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:35.300264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:35.300264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 390/762] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:35.305112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:35.438497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:35.460530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8ad2e-e5fe-4c8d-b6ec-12a3223d61e4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:35.507965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:35.508682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.508957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.509236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.509977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:35.510287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:35.511701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9131405-316a-48cf-8504-9e20d491112e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:35.536666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 373/763] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:35.542550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:35.567476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:35.620576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7855a90-da23-45f4-bdec-9b248074908a None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.620869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7855a90-da23-45f4-bdec-9b248074908a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.621152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7855a90-da23-45f4-bdec-9b248074908a None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.622810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 374/764] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:35.627840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.628134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.628418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.668157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:35.669364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:35.679458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d87c8-a11e-4bf9-a089-1cf90591a2bd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:35.715074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:35.715900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.716191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.716476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.723423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:35.725312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:35.740392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:35.741332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:35.742216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 391/765] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:35.752021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:35.824326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 375/766] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:35.857134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:35.865807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:35.918505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951acd11-75b5-4795-ba22-29dda0555cce None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:35.989323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:35.990440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:35.990967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:35.991458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:35.992441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:35.994549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:35.996576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.000519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:36.029366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 392/767] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:36.031166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:36.056618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7300-f8ae-41da-927f-63707aba9152 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:36.105622 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:36.106819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.107470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.107965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.109149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:36.110763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:36.127597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:36.128587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:36.129409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:36.132972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 376/768] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 23 15:23:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:36.139184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:36.255008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a804c-9f4f-46b0-8780-117340ffb50e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:36.297826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755c947-ea0c-48a8-828a-b48461e3fab6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:36.318998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:36.319709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.319964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.320239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.321269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:36.321575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:36.322949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.338052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 377/769] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 23 15:23:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:36.344165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:36.354034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:36.355575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:36.388385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:36.388385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.388385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.388385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/6867f7729ddf465ca6d31df087c00881/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.388777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=6867f7729ddf465ca6d31df087c00881, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:36.388777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.465141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9677b0-a4f7-4a73-8243-69ab8108f3fc None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:36.468783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 393/770] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:36 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/6867f7729ddf465ca6d31df087c00881/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:36.521680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:36.522405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.522696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.522984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.524359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:36.524673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:36.526098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aae370-5952-4fa1-8792-1a5944cc37b5 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.533287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 378/771] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 23 15:23:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:36.538776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:36.720211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4231-8afc-411f-b060-607f09b44300 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:36.767812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:36.768826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.769110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.769381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.770186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] RBAC: Adding query filter params (interface=public, service_id=996474ee080b49229bad79aff7c290df, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:36.770496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:36.771920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.777857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da85d-5483-4910-a396-96be9accb0cf None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.778157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da85d-5483-4910-a396-96be9accb0cf None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.778442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da85d-5483-4910-a396-96be9accb0cf None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.780109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 379/772] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:36.780807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 394/773] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:23:36 2022] GET /identity/v3/endpoints?service_id=996474ee080b49229bad79aff7c290df&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:36.785308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.785785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.786266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.790139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:36.805845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:36.807150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:36.863503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:36.918209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c78-17db-46e6-bbda-55f6712aeaf4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:36.931183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:36.940161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 380/774] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:36.964910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:36.965271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:36.965941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:36.966220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:36.966496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:36.967220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:36.968733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:36.974806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 395/775] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:23:36 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:37.095123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889da6c8-4e97-4367-9ea5-640edcc3fcda None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:37.135294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac932b-50a6-461f-8f32-67bb87578715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:37.136526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac932b-50a6-461f-8f32-67bb87578715 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.137026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac932b-50a6-461f-8f32-67bb87578715 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.137522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac932b-50a6-461f-8f32-67bb87578715 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.150359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac932b-50a6-461f-8f32-67bb87578715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-68ac932b-50a6-461f-8f32-67bb87578715 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:37.158775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:37.159820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:37.160676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:37.163813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 381/776] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:37.169641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:37.259133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26708-94cf-4682-b179-6bc02b435e2d None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.259133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26708-94cf-4682-b179-6bc02b435e2d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.259414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26708-94cf-4682-b179-6bc02b435e2d None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.261081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 382/777] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:37.266968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.267292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.267580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.294139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:37.297539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:37.299944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297678ca-7f70-433a-a715-777e7b36f76b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:37.337948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:37.364808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:37.365499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.365784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.366061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.366830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:37.367159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:37.368601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:37.387320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 396/778] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:37.393480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:37.395456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:37.421326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 383/779] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:37.499331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:37.568559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069261-4d19-4daf-b6f5-9571ab7f2bd9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:37.643643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:37.644466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.644748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.645022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.665960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:37.667633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:37.670281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053a975-e37b-4c2d-8c15-221db8864764 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:37.701050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:37.702024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:37.702883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:37.702883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:37.702883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:37.702883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:37.703582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 397/780] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:37.710453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:37.733797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:37.734601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.734879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.735173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] PATH_INFO: `/v3/services/network` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.735831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:37.737187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:37.753415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:37.755697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:37.757590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 384/781] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:37 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:37.770116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:37.787300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:37.871729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:37.890688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf84d0-0833-4218-9a8a-96e24362f2ba None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:37.935850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:37.936528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.936813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.936940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb15b1-7d32-40b8-bde7-a9712627c555 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:37.937102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.937824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:37.938135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:37.940660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70152fa-b493-4640-9997-71dda2d96ec4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:37.956036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 398/782] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:37.957903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23d1f-a04e-4ccc-96e9-db2f053901ee None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.958197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23d1f-a04e-4ccc-96e9-db2f053901ee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.958640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23d1f-a04e-4ccc-96e9-db2f053901ee None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.963181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 399/783] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:37.964018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23d1f-a04e-4ccc-96e9-db2f053901ee None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:37.980640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:37.981367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.981651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.981928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:37.982701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:37.983064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:37.984540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885220-a214-4062-8e34-58961307f4e2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:37.989677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 385/784] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:37.990967 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:37.991289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:37.991573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.014985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:38.016157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:38.090684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23d1f-a04e-4ccc-96e9-db2f053901ee None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.100039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 386/785] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:38.100180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.100361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.141990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.143434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.143744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.144027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.153016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.155000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.161108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:38.176322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:38.177307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:38.178258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 400/786] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:23:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:38.178865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.231787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6176-17e2-4a0d-8d61-74b48de45bd1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.274387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.275424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.275919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.276402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.277334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] RBAC: Adding query filter params (type=network) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:38.277870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.279500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.289671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 387/787] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:38.290791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.309845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365243e4-de03-4fee-94c1-8d440f34a0ac None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.357005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.358437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.359326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.360107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.374123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:38.385181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:38.386153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:38.387009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:38.391429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 401/788] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:38.392893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.414934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.416179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81dafb-b392-4cb2-8443-91009df2b242 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.428153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.453223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.454060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.454471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.454856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.455859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:38.456536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.457847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.478038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 388/789] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:38.479019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.504811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ea75-6d73-4b10-9d02-9a138448d2bb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.544981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.544981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.544981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.544981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.545389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] RBAC: Adding query filter params (interface=public, service_id=9872b96831ae46bbb8935b026086989c, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:38.545389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.545897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.551680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 402/790] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/endpoints?service_id=9872b96831ae46bbb8935b026086989c&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:38.552759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.597926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2340b-c7e3-4152-b43f-271cb1837844 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.641613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.643839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.644340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.644844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.645799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:38.646306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.648297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.652659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.664986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 389/791] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:38.664986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.683422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dc230-c435-4cb6-a32d-aa4d276db21f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.706284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.727462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.728674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.729053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.729430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.743185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.745238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:38.767719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:38.768882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:38.769879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:38.769879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:38.769879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:38.769879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:38.775197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 403/792] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:38.775197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.799694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84241807-eae7-4bd6-95c2-50535ef63693 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.845208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.846171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.846527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.846905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.847741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.849307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:38.863281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 390/793] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:38.864446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:38.896564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d650-d5b3-492d-89e0-afc4cd8f56a7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:38.934373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:38.938435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:38.939488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:38.939779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:38.940061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:38.952458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:38.957270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:39.000728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:39.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:39.002565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:39.002565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:39.002565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:39.002565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:39.002565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 404/794] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:39.016179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.020243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008ac9-c2c1-4855-9deb-5bb495f27487 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.024887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.062736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.063368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.063655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.063934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.064679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:39.064988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.066380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ddd22-45a7-469e-838b-7463bf853810 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.083330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 391/795] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:39.084976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128519e4-c95a-4cda-b586-598ced8a19fc None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.085574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128519e4-c95a-4cda-b586-598ced8a19fc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.087063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128519e4-c95a-4cda-b586-598ced8a19fc None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.091662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 392/796] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:39.092749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128519e4-c95a-4cda-b586-598ced8a19fc None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.188444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147e6a6-ea3f-4d67-acdb-af522182e0ae None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.212154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128519e4-c95a-4cda-b586-598ced8a19fc None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.225593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.226629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.227215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.227713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.236673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:39.237199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.238819 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f5ae-83b1-40ad-b2c7-269b662dfa83 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.248529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.249358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.249641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.249896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.252564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 405/797] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:39.254069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.254556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.255030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.257311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.259355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.273027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:39.274483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:39.275368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:39.276265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 393/798] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:39.277176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.278051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:39.303554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.324287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.353958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 406/799] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:39.355021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.391477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bcdbd-aa30-45a8-bda3-667f9cd5826b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.429509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.431281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.431789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.432266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.444333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.448666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.461345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c91bd8-8e99-4e7b-998c-ab976b383824 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:39.478868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:39.480075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:39.481083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:39.483777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 394/800] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:39.484843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.509765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.510767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.511196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.511477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.512276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:39.512663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.514026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.526696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 407/801] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:39.527297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.558506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.570684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.598151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b13fe-3faf-4ff6-9fb7-97feed4ccbd0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.635022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f96a67-b780-4a2b-8928-f150fba152ba None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.635233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7d4b3-c05b-4e45-9f80-9d6a0e4205d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.635914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d4b3-c05b-4e45-9f80-9d6a0e4205d0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.636166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d4b3-c05b-4e45-9f80-9d6a0e4205d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.636564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d4b3-c05b-4e45-9f80-9d6a0e4205d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.647454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7d4b3-c05b-4e45-9f80-9d6a0e4205d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-4ab7d4b3-c05b-4e45-9f80-9d6a0e4205d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:39.655738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:39.656913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:39.657758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 395/802] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:39.658450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2651-b77e-4ec1-96d1-8169ab554b57 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.658539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2651-b77e-4ec1-96d1-8169ab554b57 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.659146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2651-b77e-4ec1-96d1-8169ab554b57 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.663313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 396/803] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:39.663313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2651-b77e-4ec1-96d1-8169ab554b57 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.676324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.676998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.677279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.677554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.678392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:39.678700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.680730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.702528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 408/804] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:39.702528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.784337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2651-b77e-4ec1-96d1-8169ab554b57 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.800013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.810607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2522-c2bd-4f3c-acf4-f64a45096e96 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:39.822656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.823663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.823983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.824260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c9bdcccb57d14f44a4f93ced180dca4b/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.826827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:39.839700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=c9bdcccb57d14f44a4f93ced180dca4b, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.841121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.850744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:39.851382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.851674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.852448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.853203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:39.853511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:39.854872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f78fdf-e7a7-4568-9052-519cbefbdcc6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:39.862863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 409/805] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:39.864176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:39.864472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:39.864771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:39.880862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:39.882076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:39.951386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 410/806] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:39.958648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:39.958942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 397/807] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:39 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c9bdcccb57d14f44a4f93ced180dca4b/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:39.960161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.075822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.093239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256e245-3a31-4881-9339-9a83c35b1b84 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.096949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb502ed-7776-4320-b771-9834c8c40632 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.133566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.134631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.135075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.135541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.135924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.136782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.137075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.137352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.148042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.149660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.150030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.151136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:40.169633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:40.170639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:40.171679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:40.171679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:40.171679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:40.171679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:40.171924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:40.172710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:40.173687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:40.173687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:40.173687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:40.173687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:40.173687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 411/809] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:40.173687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.174029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 398/809] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:40.177274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.226841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.286881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ec641-ec9b-46f2-897c-e4952e29a75a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.299939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0210e8-09e0-4df8-b0a8-65a36b3e5382 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.324306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.326801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.326801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.326801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.327219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.329316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.332156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.336690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.337562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.337992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.338415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.339358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:40.339819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.341431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:40.344940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:40.346107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:23:40.346992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:40.351330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 412/810] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:40.363740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.363922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 399/811] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:40.363922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.468086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3233aa-b96d-4073-9840-ea5311be6ed4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.487643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.494265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b10e-e659-429b-9c77-4f0b063d2811 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.516077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.517099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.518002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.518484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.519694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:40.520367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.522579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.532529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.533632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.533632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.533902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.534722 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:40.535111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.536567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.540775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 413/812] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:40.541904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.546736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 400/813] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:40.547121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.621790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.653069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d457-d449-4fd8-afc0-47a0499fbd1f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.671681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d7ca-6b45-46c2-a76f-fa9443977437 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.690011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.690905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.691280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.691659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.699629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.701230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.712341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.713427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.713911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.714376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:40.716742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:40.717764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:40.718840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 401/814] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:40.719581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.726661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.728463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:40.743603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:40.744600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:23:40.745563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:40.746122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.752675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 414/815] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:40.758771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.830097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1135e1-6f7b-4854-a5a9-5315f483258d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.869641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.870553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.870978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.871417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.872380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:40.872836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.874429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.875689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00f2b-a8aa-462d-ad5b-3bea3415067e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:40.880411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 402/816] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:40.886507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.894738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.911869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:40.912538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:40.912828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:40.913205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:40.913886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:40.914202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:40.916429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:40.928926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 415/817] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:40.929794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:40.978214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:40.996605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5ef6-7615-4997-9553-a03efa809e04 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.034678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52c724-5dc8-4cd6-ac7d-d0567e19f48b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.045071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.046865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.047409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.048355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.049825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:41.050655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.053353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.079382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.080057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.080344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.080624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.081385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.082080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 403/818] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:23:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:41.083080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:41.087305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.186978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 416/819] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:23:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:41.186978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:41.233388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702d05e-82b4-4b16-a1f4-3ac66aa3ecf5 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.261388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:41.290209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a702c5-9245-45a5-8d0f-2c6b1d7ac3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.291133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a702c5-9245-45a5-8d0f-2c6b1d7ac3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.291424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a702c5-9245-45a5-8d0f-2c6b1d7ac3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.291702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a702c5-9245-45a5-8d0f-2c6b1d7ac3c4 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c2deaa48dbdb477f971178bd535395a5/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.295277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a702c5-9245-45a5-8d0f-2c6b1d7ac3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=c2deaa48dbdb477f971178bd535395a5, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.296740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a702c5-9245-45a5-8d0f-2c6b1d7ac3c4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.340915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70359d7c-1858-463d-90c8-3f7ad5cf9a28 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.363369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:41.372228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 404/820] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:41 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c2deaa48dbdb477f971178bd535395a5/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:41.375246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644a5ab-c4c5-4a57-ac1a-be822f1047f2 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.375905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644a5ab-c4c5-4a57-ac1a-be822f1047f2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.376359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644a5ab-c4c5-4a57-ac1a-be822f1047f2 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.383363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 405/821] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:41.385794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.386193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.386378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.386674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.387416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.387913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.388434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.409081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:41.411028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:41.495429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.497174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.511697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 406/822] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:41.540117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:41.541581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:41.623194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 417/823] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:23:41.625454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:41.661226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab29c-fc70-4ab1-9750-0dcb7f639d74 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.689385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:41.697959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.699120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.699631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.700114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.700987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.702592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:41.716579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:41.728908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:41.729751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 407/824] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:41 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:41.730538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:41.768653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd7508-d8b7-4df1-8202-8a56d85a6aac None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.843292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcca3f-e49b-4c8c-b3b0-2e4462644ee0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:41.881054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.882086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.882613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.883181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.884603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:41.885126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.886687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.891900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 408/825] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:41.896284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:41.896639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:41.896923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:41.897197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:41.897834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:41.902069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:41.932227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:41.933702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:41.965475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:41.981312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:41.988336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:41.989458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:41.989458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:41.989458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:41.989458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:41.989458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 418/826] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:41.989458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.030467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579fe88-85c2-4292-b7c2-d9c1da616ac0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.093701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.095496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.098937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.099406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.100602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] RBAC: Adding query filter params (type=network) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:42.101078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:42.103176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:42.121747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 409/827] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:42.137581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.201908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f56eb-2ee2-4d86-9ba3-4649a52131a3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.274547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.275250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.275538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.275813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.276554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:42.276862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:42.278255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:42.304036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 419/828] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:42.308730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.329799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b98ce0-514d-4bee-8356-0b9d660f5932 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.364974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:42.377383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:42.392579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151c63f-3806-481f-b581-0c90914d24b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.393255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151c63f-3806-481f-b581-0c90914d24b9 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.393538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151c63f-3806-481f-b581-0c90914d24b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.393812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151c63f-3806-481f-b581-0c90914d24b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.394556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151c63f-3806-481f-b581-0c90914d24b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:42.395949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151c63f-3806-481f-b581-0c90914d24b9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:42.439448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5c640-8b0a-4f80-9b8c-78053c936046 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.472826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.473610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.473896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.474177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.480916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:42.482457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:42.495513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 410/829] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:23:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:42.502619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:42.503585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:42.504500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 420/830] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:42.504993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471432-899f-4789-b435-033e8012d7fc None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.504993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471432-899f-4789-b435-033e8012d7fc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.504993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471432-899f-4789-b435-033e8012d7fc None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.506920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 411/831] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:42.514042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.515037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.515552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.516506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.552846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:42.555883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:42.710790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 412/832] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:42.736875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.741706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3eccc-e2f0-4cd0-a039-0441b6eb559f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.750366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:42.785397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.786069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.786352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.786630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.787457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:42.787771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:42.789227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:42.802483 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 421/833] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:42.808922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.846790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be78a6-ea61-46ea-94e3-e8c2d40bdf8a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.848384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:42.883665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.884782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.885213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.885645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.897001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:42.905264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:42.906404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:23:42.907487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:42.909806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 413/834] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:23:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:42.916048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:42.917304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ded26-f4a6-44f2-b00d-4a9d3c4cdc3a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:42.958143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:42.958811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:42.959113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:42.959397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:42.960228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=6867f7729ddf465ca6d31df087c00881) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:42.960543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:42.962043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:42.969225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 422/835] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:42 2022] GET /identity/v3/role_assignments?user.id=6867f7729ddf465ca6d31df087c00881&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:43.032980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41648aa-09f8-4ae2-92c5-ffca747b85bb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:43.072309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:43.073243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.073680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.074105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.075151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:43.075681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:43.077251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:43.087836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 414/836] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:23:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:43.093790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:43.132191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:43.214189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208dc8d-9f5b-49db-90f5-b8c2fb01f93c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:43.261309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:43.262105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.262388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.262663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.274323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:43.275827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:43.294084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:43.295051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:43.296005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:43.296005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:43.296005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:43.296005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:43.296005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 423/837] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:43.302005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:43.331220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:43.411150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7234-1079-44fc-b8bf-d28988ddb69c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:43.447411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:43.448422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.448896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.449352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.450256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:43.450744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:43.452394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:43.465402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 415/838] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:43.471090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:43.567284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:43.587520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43ef1-6f66-4fcc-977d-0c35b8d8672b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:43.624719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:43.625551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.625833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.626104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.635986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:43.637513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9d1f813c-a274-408e-8984-47cc7851554a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:43.655200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:43.656211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:43.657161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 424/839] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:23:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:43.664181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:43.757089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:43.772807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa976-1d3b-4b51-a194-40c0e15c1fcf None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:43.809300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:43.810393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.810681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.810961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.811836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:43.812151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:43.813576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:43.832736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 416/840] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 23 15:23:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:43.833451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5737-541b-46a4-b8de-e5f8d2f2df36 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.833856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5737-541b-46a4-b8de-e5f8d2f2df36 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.834142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5737-541b-46a4-b8de-e5f8d2f2df36 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.838751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 425/841] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:43.839708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:43.843929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57a4a-027b-4af5-8a9f-6c2a65e413fe None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.844220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57a4a-027b-4af5-8a9f-6c2a65e413fe None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.844503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57a4a-027b-4af5-8a9f-6c2a65e413fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.863719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e6d57a4a-027b-4af5-8a9f-6c2a65e413fe None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:43.865473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e6d57a4a-027b-4af5-8a9f-6c2a65e413fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:43.941045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 426/842] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:43.942460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc918a-6d1a-47a3-9e4b-a67aa0804991 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.942745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc918a-6d1a-47a3-9e4b-a67aa0804991 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.943022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc918a-6d1a-47a3-9e4b-a67aa0804991 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.944318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 427/843] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:43.949694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:43.950001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:43.950262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:43.961621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7f75-f218-46d8-b703-34c01d4eb557 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:43.969977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:43.971271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:43.998855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:43.999894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.000490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.001107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.013553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.041606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 428/844] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:44.042583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.056294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.075697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.077139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.145410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a766e51-d97b-476e-a000-f2217ece6fcb None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.184894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.185706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.185993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.186275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.193042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 417/845] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:23:44.193042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.198714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:44.206464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:44.207417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:44.208249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 429/846] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:44.208976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.246322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.288552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.306994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01087e-76b5-48d7-85c7-a838ef9a25c4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.328989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e101-9191-4a36-863a-612155b8b09d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.347587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.348392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.349080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.349391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.350578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.352678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.363081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.363887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.364181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.364458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:44.366765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:44.368302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:44.374324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 418/847] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:44.375147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.375541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.377292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:44.394183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:44.395578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:44.396500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:44.396500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:44.396500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:44.396500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:44.396500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 430/848] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:44.396500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.485381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d1ac8-1f8a-4c6d-a018-59c943cd8504 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.492273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.504733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72faa-8363-4537-ba38-0b4130c988cc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.519445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.520287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.521182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.521466 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.521740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.522483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:44.522958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.524716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.537309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 419/849] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:44.537309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.545689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.549870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.549870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.549870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.549870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:44.549870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.549870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.558751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 431/850] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:44.558751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.648478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d64817-6341-44b9-a800-32605f4aa946 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.658358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be387c03-08cd-44ff-af6d-c041c090c7e3 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.685340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.686003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.686353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.686620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.687455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:44.687774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.689139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.693407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.694202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.694497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.694774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.706179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 420/851] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:44.706179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.710952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.712548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:44.730012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:44.730920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:44.731870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:44.731870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:44.731870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:44.731870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:44.731870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 432/852] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:44.732568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.742283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.764951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:44.824820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe82b2-e1ec-4d0b-a354-a2f5a79171fa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.837196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a817c-ea4b-4492-ac32-0c976fd58fd8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:44.865136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.865958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.866522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.866817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.868233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:44.868514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.870255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.872122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:44.872921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:44.873211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:44.873502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:44.875488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 421/853] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:44.884004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:44.889731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:44.891285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:44.907078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:44.908051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:44.908929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 433/854] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:44.914070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.000372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34e0f-cdf9-45dd-a86f-776e8d6c153f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.003555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.036490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.041961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.042981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.043536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.044020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.044996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:45.045526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.045923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfac23-ab9a-425e-bd78-53c03ee6b6cf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.047736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.061966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 422/855] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:45.071151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.095796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.096535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.096827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.098031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.098858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:45.099349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.102405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.123251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 434/856] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:45.124993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.203893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de254de-c8b2-4176-8579-8517ec091f59 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.247521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b330e-294f-42c1-b5b7-2ee1b6773f9b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.262752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.263578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.263855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.264126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.272682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.274686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.289028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:45.289312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:45.290223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:23:45.291206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:45.292977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.293490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.293970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.295018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c9bdcccb57d14f44a4f93ced180dca4b) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:45.295525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 423/857] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:45.295851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.297014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.297857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274452b4-e56c-48b3-bbaa-14b6d08968fd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.306693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 435/858] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/role_assignments?user.id=c9bdcccb57d14f44a4f93ced180dca4b&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:45.318759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.399627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab16edd-4baf-41db-8b50-5aa29b0079c8 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.400007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab16edd-4baf-41db-8b50-5aa29b0079c8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.400659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab16edd-4baf-41db-8b50-5aa29b0079c8 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.403245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 436/859] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:45.409035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.409327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.409605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.426844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3673a-19d6-425c-bb2f-8b0795674cd8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.434491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:45.436896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:45.452541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.468080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.468080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.468080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.468596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.469217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:45.469528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.471046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.494419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 424/860] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:45.500388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.536793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 437/861] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:45.559607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.590079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.627314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d16d-0072-4e0e-8d1c-30a11c5fad50 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.671028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.672326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.672829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.673853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.682849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05874bf-cd42-492e-9d62-53fbef9ca870 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.723720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.730052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.730457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.731317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.732561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.734393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:45.752741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:45.753731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:45.754561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:45.755604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 438/862] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:45.764033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.764205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.765774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.777632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.843455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:45.870673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 425/863] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:23:45.877386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.895491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb578df-b13c-44b7-955f-bf484fbf732a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:45.929762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:45.930481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:45.930763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:45.931123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:45.931849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:45.932220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:45.933592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:45.942801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 439/864] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:45.944216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:45.988824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276e622-55b7-4d0c-b3c0-e665c4db2d02 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:46.027471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:46.029210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:46.029835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:46.030328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:46.034237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:46.043255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:46.046306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:46.064318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:46.065243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:46.066182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:46.066182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:46.066182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:46.066182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:46.073002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d78438-d17d-4ffe-8ada-639530157579 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:46.073151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 426/865] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:46.074119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:46.103474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:46.120544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:46.121650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:46.122177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:46.122748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:46.123791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:46.124306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:46.126088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:46.131680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 440/866] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:46.191298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc05ced-3f3d-425e-9a54-62d8a70f0b8e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:46.231928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:46.231928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:46.232199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:46.232464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:46.234183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:46.234183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:46.234959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:46.248699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 427/867] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:46.254296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:46.363849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4414e0-ed3b-4c56-a6c5-2c76c2b140bc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:46.398413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:46.399762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:46.400049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:46.400321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:46.403387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:46.407792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:46.409238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:46.423898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:46.424921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:46.425803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 441/868] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:46.431075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:46.520033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:46.535899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb106df-00d6-44c2-b266-a376933a77fa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:46.571348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:46.572114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:46.572403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:46.572680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:46.573476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:46.573784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:46.575233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfd22-5948-471b-9679-9ec2943e0726 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:46.588710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 428/869] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:46.595369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:46.699253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72bd48-6cbc-4212-a2f7-e09822b47eeb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:46.735189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:46.735850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:46.736135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:46.736414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:46.737250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c2deaa48dbdb477f971178bd535395a5) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:46.737565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:46.739007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6a9e-e74d-47be-9c04-e25dfafcb733 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:46.745622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 442/870] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:46 2022] GET /identity/v3/role_assignments?user.id=c2deaa48dbdb477f971178bd535395a5&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:47.280751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95851d8-5f66-4472-a5d4-58446c0b8c33 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:47.281736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95851d8-5f66-4472-a5d4-58446c0b8c33 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:47.282219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95851d8-5f66-4472-a5d4-58446c0b8c33 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:47.284150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 429/871] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:47.290674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadaae6-6866-448d-89d7-4cb1621f3fdc None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:47.291343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadaae6-6866-448d-89d7-4cb1621f3fdc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:47.291827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadaae6-6866-448d-89d7-4cb1621f3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:47.309501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6eadaae6-6866-448d-89d7-4cb1621f3fdc None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:47.311044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6eadaae6-6866-448d-89d7-4cb1621f3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:47.371595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:47.383246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 443/872] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:47.406861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95851d8-5f66-4472-a5d4-58446c0b8c33 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:47.514881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95851d8-5f66-4472-a5d4-58446c0b8c33 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:47.562985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c6fd2-6693-4179-8473-b20a7e894252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:47.563703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6fd2-6693-4179-8473-b20a7e894252 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:47.563989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6fd2-6693-4179-8473-b20a7e894252 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:47.564266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c6fd2-6693-4179-8473-b20a7e894252 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:47.565013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c6fd2-6693-4179-8473-b20a7e894252 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:47.566377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c6fd2-6693-4179-8473-b20a7e894252 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:47.656514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 430/873] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:23:47 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:47.719583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cc0fb-c296-4356-bc8a-0393a188d03f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:47.720103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cc0fb-c296-4356-bc8a-0393a188d03f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:47.720208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cc0fb-c296-4356-bc8a-0393a188d03f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:47.721878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 444/874] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:47.728828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:47.729132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:47.729386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:47.734826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:47.748208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:47.749467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:47.833560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 431/875] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:47.858508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cc0fb-c296-4356-bc8a-0393a188d03f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:47.970787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cc0fb-c296-4356-bc8a-0393a188d03f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.006730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.008427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.008942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.009479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.020528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:48.029361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:48.030382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:23:48.031237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:48.034203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 445/876] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 23 15:23:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:48.040841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:48.145714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602fd1-7ba8-47df-a14d-9f8a79b1c3d2 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.173501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:48.183120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.196141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.196141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.196141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.196141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:48.196141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:48.196141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:48.197141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 432/877] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:23:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:48.202918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:48.270598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:48.323014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac8b2-cf6a-4f17-85b5-0a8e77170bd4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.357277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.358133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.358415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.358748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.369977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:48.371480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-278cc106-77b0-46d1-8691-af0945ca9a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:48.389288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:48.390196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:48.391077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:48.391077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:48.391077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:48.391077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:48.391077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 446/878] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:48.397651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:48.419793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2646-77e4-4918-90c3-ba718b33183a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.420134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2646-77e4-4918-90c3-ba718b33183a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.420351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2646-77e4-4918-90c3-ba718b33183a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.422998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 447/879] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:48.426930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.427253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.427534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.448993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:48.450179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:48.520940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b52bdd-6bfe-4a66-9862-b20c90acc1cc None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.532530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 448/880] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:48.558514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.559231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.559514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.559789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.560517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:48.560823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:48.561100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:48.562188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:48.583048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 433/881] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:48.584728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:48.603901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:48.652672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:48.693360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee47e4-eb0d-4f9b-b808-43e3928faab4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.712286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f8ec-855f-4e6b-bbd5-5a43b4627bbe None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.732008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.733443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.733929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.734424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.735379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:48.737133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:48.746949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.747797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.748079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.748353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.756322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:48.757744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:48.773039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:48.774649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 434/882] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:23:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:48.782245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:48.807253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 449/883] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:23:48 2022] POST /identity/v3/services => generated 269 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:48.902984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774da2d2-efa8-4aa4-a290-07286f3642e4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:48.915981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:48.960617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:48.962265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:48.962982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:48.963523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:48.964602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:48.965123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:48.966824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a582-c4a7-43f4-ba1a-9eb45c012e77 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:48.989083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 435/884] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 23 15:23:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:48.995941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.099784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:49.106448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f098e-c997-4ae7-bab7-12bd1d74e9dd None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.120723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3cbba-1430-4eec-8b26-816c01978248 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.121012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3cbba-1430-4eec-8b26-816c01978248 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.121280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3cbba-1430-4eec-8b26-816c01978248 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.122661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 436/885] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:49.127842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.128246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.128630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.145615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:49.146988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:49.154262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.155002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.155828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.156143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.237208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 437/886] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:49.254532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.256048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.261600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.348541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:49.358961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 450/887] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:48 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:23:49.365490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.371143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:49.378445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42985aa-ac71-4836-bcb1-15acb1b84198 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.419523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.421104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.421617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.422056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.422871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.424513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:49.439261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:49.440503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:49.441375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:49.449380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 438/888] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:49.450534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.471036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05f49-6001-4a6b-8acc-2b51d5f6532a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.506888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.508407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.509003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.509622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.520601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.522209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:49.545191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:49.546808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:49.548258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:49.548258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:49.548258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:49.548258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:49.554357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 451/889] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:49.556114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.587753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6722a-0efa-426b-ae6a-d292f2f97f7e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.609247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:49.626756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.627780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.628211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.628633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.629520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:49.629978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.631519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.642634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 439/890] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:49.643945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.667139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef525-8228-4acb-8d96-414d8048773c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.673921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:49.703049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.703657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.704201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.704595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.706079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:49.706491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.708233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.725882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 452/891] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:49.727832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.774424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be9663-3c12-4b1e-b365-043dac56400b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.821560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.822865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.823509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.823865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.824913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:49.825301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.827224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.834348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 440/892] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:49.848657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c3ab-d35c-46d8-ac75-6db965bf3f99 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:49.852577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:49.890654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:49.891609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.891966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.892313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.901094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:49.902825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-31220bb2-8072-457a-91a7-c290a29e2fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:49.918682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:49.919875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:49.920958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:49.922364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 453/893] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:49.928766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:49.994608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b060-788e-4a67-a39a-8079e8ce1b28 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:49.994993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b060-788e-4a67-a39a-8079e8ce1b28 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:49.995363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b060-788e-4a67-a39a-8079e8ce1b28 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:49.996983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 454/894] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:50.004436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.004953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.005672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.027389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:50.028217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:50.029513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:50.041596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36f898-7cd8-4d27-8678-03f8756c15ed None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.085094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.086624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.087134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.087525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.088578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:50.088986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.091218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.107348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 441/895] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:50.112493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:50.119468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 455/896] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:50.142429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:50.222794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f8d50-dfde-43ca-9e64-a3f813ff85a8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.245258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:50.252354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c9d84-4eef-41a9-9033-3361ce098fa4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.263365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.264324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.264752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.265174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.266152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] RBAC: Adding query filter params (role.id=2bc8445e24e44f379e0a777e8b0c3d4c, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c9bdcccb57d14f44a4f93ced180dca4b) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:50.266662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.268264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.274449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 442/897] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:23:50 2022] GET /identity/v3/role_assignments?user.id=c9bdcccb57d14f44a4f93ced180dca4b&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=2bc8445e24e44f379e0a777e8b0c3d4c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:50.295459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.296549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.297078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.297505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.298382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.300096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:50.313873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:50.315237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:50.316269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:50.318862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 456/898] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:50.324758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:50.339539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:50.441391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e600a-b90b-4a69-a93d-fbab93f56048 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.481123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.482064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.482539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.482958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.483854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:50.484308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.485872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.491326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 443/899] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:50.497285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:50.612166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad481b-bad7-4df0-a10f-0c3c31fa0564 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.647021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.647768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.648057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.648330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.649588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:50.649892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.651298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.657181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 457/900] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:50.663252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:50.740126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:50.767407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab431e-dd9a-4f6c-b2c4-c3e520c2384c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.812822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.813498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.813784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.814065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.814874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] RBAC: Adding query filter params (interface=public, service_id=20ed3d7771a34aaa9bd7f4c96319b189, region_id=RegionOne) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:50.815212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.816592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd4b05-34db-4498-be56-6343cdd02c3a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.825710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 444/901] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:23:50 2022] GET /identity/v3/endpoints?service_id=20ed3d7771a34aaa9bd7f4c96319b189&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:50.830919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:50.862522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:50.944531 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde67517-f983-41ee-9712-56551eb48083 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:50.986000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67476a-c0d0-4b2c-a155-db71aceaa9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:50.986681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67476a-c0d0-4b2c-a155-db71aceaa9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:50.986964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67476a-c0d0-4b2c-a155-db71aceaa9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:50.987271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67476a-c0d0-4b2c-a155-db71aceaa9a9 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:50.987964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67476a-c0d0-4b2c-a155-db71aceaa9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:50.989370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67476a-c0d0-4b2c-a155-db71aceaa9a9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:50.997989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 458/902] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:23:50 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:23:51.208358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332eb9-a9dd-4594-a27c-3f7a04fdf6ac None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:51.209036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332eb9-a9dd-4594-a27c-3f7a04fdf6ac None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:51.209469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332eb9-a9dd-4594-a27c-3f7a04fdf6ac None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:51.211356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 445/903] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:51.216848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:51.217143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:51.217482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:51.244105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:51.249203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:51.321109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 459/904] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:51.345395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332eb9-a9dd-4594-a27c-3f7a04fdf6ac None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:51.458414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332eb9-a9dd-4594-a27c-3f7a04fdf6ac None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:51.496241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:51.497072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:51.497502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:51.497972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:51.499125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:51.501105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:51.513820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:51.514776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:51.515650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 446/905] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 23 15:23:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:51.521288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:51.543517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:51.640941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ecc-4f87-48f2-9015-5bb0f4b09dae None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:51.676804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:51.677479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:51.677762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:51.678038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:51.678750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:51.679057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:51.680658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:51.685934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 460/906] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:51.691459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:51.694588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:51.796232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff516a1-cf2f-47f0-849c-f790594c099e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:51.831364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:51.832076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:51.832368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:51.832645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:51.833360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:51.833668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:51.835033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:51.840891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 447/907] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:51.846553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:51.930425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:51.950434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a88b7-8975-4013-b5e9-b0dfda090e58 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:51.985735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:51.986402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:51.986690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:51.986969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:51.987789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] RBAC: Adding query filter params (interface=public, service_id=7d1cfac062db4be193dc07c989bebe08, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:51.988103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:51.989480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94cf79-2c1d-4ebd-8a8b-5d053c28cde5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:51.994952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 461/908] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:23:51 2022] GET /identity/v3/endpoints?service_id=7d1cfac062db4be193dc07c989bebe08&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:52.000397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:52.070395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:52.107624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8adc9-96b0-4eb2-8d0f-1b394c9b8f90 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:52.142352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed39c-7643-4137-bfa8-d38f4eecbcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:52.143031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed39c-7643-4137-bfa8-d38f4eecbcdb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.143734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed39c-7643-4137-bfa8-d38f4eecbcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.144027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed39c-7643-4137-bfa8-d38f4eecbcdb None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.144724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ed39c-7643-4137-bfa8-d38f4eecbcdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:52.146460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ed39c-7643-4137-bfa8-d38f4eecbcdb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:52.153063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 448/909] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:23:51 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:23:52.264863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fd8fb-13e2-4249-be52-70f38453ce36 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.265220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fd8fb-13e2-4249-be52-70f38453ce36 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.265437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fd8fb-13e2-4249-be52-70f38453ce36 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.266942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 462/910] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:52.272792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b3047-4a63-41fd-bffb-02184e1d4aab None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.273398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b3047-4a63-41fd-bffb-02184e1d4aab None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.273948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b3047-4a63-41fd-bffb-02184e1d4aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.296923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-244b3047-4a63-41fd-bffb-02184e1d4aab None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:52.298152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-244b3047-4a63-41fd-bffb-02184e1d4aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:52.373637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 449/911] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:52.396115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fd8fb-13e2-4249-be52-70f38453ce36 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:52.506039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fd8fb-13e2-4249-be52-70f38453ce36 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:52.541148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53928d85-2376-46ba-a65a-1ab769b63709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:52.541817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53928d85-2376-46ba-a65a-1ab769b63709 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.542103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53928d85-2376-46ba-a65a-1ab769b63709 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.542380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53928d85-2376-46ba-a65a-1ab769b63709 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.543128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53928d85-2376-46ba-a65a-1ab769b63709 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:52.544647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53928d85-2376-46ba-a65a-1ab769b63709 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:52.638755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 463/912] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:23:52 2022] POST /identity/v3/services => generated 241 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:52.662765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8f0f7-919b-4e3d-9afe-98506433c8fd None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.663318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8f0f7-919b-4e3d-9afe-98506433c8fd None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.663430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8f0f7-919b-4e3d-9afe-98506433c8fd None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.665376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 450/913] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:52.671534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.671826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.672109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.678811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:52.692303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:52.693627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:52.780916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 464/914] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:52.803997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8f0f7-919b-4e3d-9afe-98506433c8fd None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:52.893966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:52.939214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8f0f7-919b-4e3d-9afe-98506433c8fd None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:52.975717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:52.977516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:52.977999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:52.978469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:52.989197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:52.998214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:52.999212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:23:53.000049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:53.002936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 451/915] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 23 15:23:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:53.009180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.112282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a0a1-d7b9-4963-bbfa-70c3c04f2629 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.142346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:53.152438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.157217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.157217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.157217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.157217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:53.157217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.157217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.165561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 465/916] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:53.171126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.280595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376590c-9db9-45e7-ac09-1d4163e99f72 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.303770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:53.315232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.316033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.317984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.317984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.328068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.329519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-9a48c364-74c6-4032-8f0e-3cbe700aee60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:53.347550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:53.348487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:53.349397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:53.349397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:53.349397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:53.349397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:53.349397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 452/917] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:53.355262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.403508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6d80-9289-47f3-88d9-c3d6f1c6250e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.403793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6d80-9289-47f3-88d9-c3d6f1c6250e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.403973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff6d80-9289-47f3-88d9-c3d6f1c6250e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.405589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 453/918] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:53.412282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.412680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.413108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.435607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:53.436895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:53.466168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b8b0-6929-40f3-bb4c-4e92201a0eba None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.505303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.506408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.506899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.507404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.508890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:53.509457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.511041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.525654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 466/919] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:53.526502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 454/920] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:53.531188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.549850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.600475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:53.660822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c27231-a585-4eda-affe-2ddcfb254308 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.668265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f744-833c-446a-8494-6030ac0b45ee None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.670627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:53.704706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.705447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.705730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.706086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.709026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.710044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.710527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.711050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.711951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.713509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.713618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.715179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:53.726743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:53.727745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:23:53.728677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:53.731187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 455/921] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:53.736176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:53.737076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 467/922] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:53.738030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.738687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.851496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1720729-9e61-4089-b37a-b42490f8d383 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.877854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6f51-27b0-4526-b371-27194847e728 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:53.893379 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.894539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.895027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.895548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.896601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:53.896778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:53.897644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.899340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.918400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 456/923] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:53.924392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.928052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:53.929757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:53.930638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:53.930922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:53.931675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:53.931988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:53.933386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:53.940740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 468/924] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:53.947624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:53.957982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:54.053117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ae3a6-9fc0-4ea5-82a6-5d7a5187ef2a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.068750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a63e3-119b-4a9d-8162-b1fb999c8147 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.091559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.092701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.093193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.093702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.105635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.106308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.106594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.106890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.107229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.107627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:54.107936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.109316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.109507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.119472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 469/925] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:54.120877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:54.129370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:54.130284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:54.131239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:54.131239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:54.131239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:54.131239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:54.137977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 457/926] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:54.139061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.165325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:54.220824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:54.227785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137aeac-eea8-4edc-ba2a-97e1ff2d2b13 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.256058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7eec2-268f-4296-a672-6dfdfb0adb7c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.267241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.267720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.268006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.268280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.269019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.270502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.295854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.296578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.296946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.297228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.297987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:54.298407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.299799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.311848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 458/927] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:54.317039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.335763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 470/928] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:23:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:23:54.445420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550b402-8485-4c88-bc91-e04f3b82bf49 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.484459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:54.489896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.490904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.491223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.496508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.499238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.500728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ee9d3f9f-a51e-4f3f-96e4-e845ffe61d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:54.516339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:54.517311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:54.518202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 459/929] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:54.524813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.555158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7569-8493-49e0-ac57-8b459c662746 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.555473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7569-8493-49e0-ac57-8b459c662746 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.555711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7569-8493-49e0-ac57-8b459c662746 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.557264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 460/930] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:23:54.562946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.563292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.563578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.584952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:54.587033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:54.650037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:54.665975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fceea8-3635-4bd9-9830-bd028d436111 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.684221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 461/931] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:54.707050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.710766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.711700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.711956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.713779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:54.715603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.715768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.716598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.729447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 471/932] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:54.735592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.831233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e260d31-6b68-4da8-b12d-d366560f9ab9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.859653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:54.872232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.873563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.874048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.874504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.875507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.877186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:54.878956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4383d-bf79-49be-9dc5-695f3368187a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:54.892488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:54.893449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:23:54.894262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:54.902681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 462/933] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 23 15:23:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:54.903923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:54.917666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b0edd-d660-4898-ae8c-985f77fef0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:54.918933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b0edd-d660-4898-ae8c-985f77fef0b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:54.919251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b0edd-d660-4898-ae8c-985f77fef0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:54.919533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b0edd-d660-4898-ae8c-985f77fef0b8 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c9bdcccb57d14f44a4f93ced180dca4b/roles/2bc8445e24e44f379e0a777e8b0c3d4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:54.922402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b0edd-d660-4898-ae8c-985f77fef0b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=c9bdcccb57d14f44a4f93ced180dca4b, role_id=2bc8445e24e44f379e0a777e8b0c3d4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:54.924103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b0edd-d660-4898-ae8c-985f77fef0b8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.004176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 472/934] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:23:54 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/c9bdcccb57d14f44a4f93ced180dca4b/roles/2bc8445e24e44f379e0a777e8b0c3d4c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:23:55.025736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4699a-0f23-40e3-bd65-8cac28f2522c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.026341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d763-e2eb-47d0-8d4c-b85f8f40b674 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.026637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d763-e2eb-47d0-8d4c-b85f8f40b674 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.026967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d763-e2eb-47d0-8d4c-b85f8f40b674 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.028743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 473/935] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:55.034629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.034954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.035223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.060062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:55.061292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:55.070912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.072104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.072596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.073115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.074092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:55.074634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.074794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:55.076544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.083039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 463/936] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:55.089791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:55.145179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 474/937] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:55.156441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:55.173173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:55.228476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ada31-96f3-4a36-a45d-b0258cdd2df8 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.270135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.271344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.271647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.271925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.272645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:55.272953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.274918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.281402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 464/938] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:55.291282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:55.306223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b98406-c4e9-43bb-ac00-21daf96de81a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.343717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.344542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.344852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.345105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.345786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.348073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:55.360688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:55.361920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:55.362964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:55.364559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 475/939] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:55.370301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:55.384193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:55.423881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc3130-9bf1-4ac5-b4f1-87eea106df21 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.442505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:55.466899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.467713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.468062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.468425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.469560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.471564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.496758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7094-2de1-49a8-8139-26227306adae None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.531983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.532623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.532903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.533178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.533883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:55.534219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.535607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.540859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 476/940] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:23:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:55.546244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:55.555852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 465/941] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:23:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:23:55.645584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:55.674227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc469c9-22f5-4d12-84ee-2a608aa5f210 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.724122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.725061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.725342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.725615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.726327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:55.726668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.728101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.734048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 477/942] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:23:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:55.739985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:55.850234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e9b08-fdd6-49c6-8566-974e1d6f9d6e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:55.885695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:55.886367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:55.886735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:55.886960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:55.887752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] RBAC: Adding query filter params (interface=public, service_id=d358410973964496acf6590ee91b7bf6, region_id=RegionOne) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:55.888068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:55.889446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167fec6-1c57-440b-ae46-2fbe0714c5e9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:55.895585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 466/943] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:23:55 2022] GET /identity/v3/endpoints?service_id=d358410973964496acf6590ee91b7bf6&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:55.901285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:56.005147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c160c-d9a2-4c5b-9fb0-bbd3e65cc597 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:56.040228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e67cc4-9d18-4244-8112-cc29a2869e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:56.041321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e67cc4-9d18-4244-8112-cc29a2869e8d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:56.041801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e67cc4-9d18-4244-8112-cc29a2869e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:56.042280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e67cc4-9d18-4244-8112-cc29a2869e8d None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:56.043221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e67cc4-9d18-4244-8112-cc29a2869e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:56.044845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e67cc4-9d18-4244-8112-cc29a2869e8d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:56.046139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:56.055627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 478/944] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:23:55 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:23:56.732821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896eab9-bd9a-47fa-8bd3-a808b4c612f3 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:56.733490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896eab9-bd9a-47fa-8bd3-a808b4c612f3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:56.733974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896eab9-bd9a-47fa-8bd3-a808b4c612f3 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:56.736152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 467/945] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:56.743537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:56.744576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:56.745225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:56.762750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:56.764379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:56.836352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 479/946] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:56.859979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896eab9-bd9a-47fa-8bd3-a808b4c612f3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:56.900443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:56.971456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896eab9-bd9a-47fa-8bd3-a808b4c612f3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:57.007123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:57.007808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.008211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.008609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.009487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:57.010914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:57.012461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING keystone.server.flask.common [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 15:23:57.076795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.sql.core [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:23:57.076795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 15:23:57.076795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [parameters: {'id': '402b628306d343b196fa5e7341305ac8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 15:23:57.076795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 402b628306d343b196fa5e7341305ac8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 402b628306d343b196fa5e7341305ac8. May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application conn.query(q) May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:23:57.084493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result.read() May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 15:23:57.085274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application next(self.gen) May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application yield resource May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application next(self.gen) May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise self.value May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application session.commit() May 23 15:23:57.087179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.session.flush() May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application compat.raise_( May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:23:57.088071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:23:57.088955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application conn.query(q) May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application result.read() May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:23:57.089993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [parameters: {'id': '402b628306d343b196fa5e7341305ac8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:57.090896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:57.093429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 402b628306d343b196fa5e7341305ac8. May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:57.095717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 468/947] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 23 15:23:56 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:57.105896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:57.212209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e064-8524-4b62-82d2-b707c56a954a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:57.243049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:57.251382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:57.252496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.252975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.253443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.263857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:57.263857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fd63858b-2caf-4b43-8a28-452a61b9f433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:57.277690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:57.278587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:57.279991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 480/948] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:57.287149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:57.401848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fdafc-8861-4b2f-988a-de2c0fc552f7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:57.403506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:57.437539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:57.438200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.438484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.438876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.439668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:57.439972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:57.441699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7d446-8822-48d7-8f4d-08a33472cc52 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:57.463427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 469/949] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:57.493999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43795cf5-4d59-420c-8a05-707a8c1da91c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.494335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43795cf5-4d59-420c-8a05-707a8c1da91c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.494565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43795cf5-4d59-420c-8a05-707a8c1da91c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.496389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 481/950] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:57.502403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.502695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.502975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.521674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:57.523241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:57.603939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 470/951] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:57.626968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43795cf5-4d59-420c-8a05-707a8c1da91c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:57.749145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43795cf5-4d59-420c-8a05-707a8c1da91c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:57.788046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6ea21-2ca5-4faa-874a-3dfb4a67a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:57.788785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6ea21-2ca5-4faa-874a-3dfb4a67a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.789101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6ea21-2ca5-4faa-874a-3dfb4a67a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.789380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6ea21-2ca5-4faa-874a-3dfb4a67a5c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.800650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6ea21-2ca5-4faa-874a-3dfb4a67a5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c8c6ea21-2ca5-4faa-874a-3dfb4a67a5c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:23:57.809493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:57.810421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:57.811714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 482/952] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 23 15:23:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:57.816982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:57.898862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:57.917829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e3f20-211d-4375-a262-547fcba12d40 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:57.953987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2b16-bfdd-4f02-a1c3-f4523e29128a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.954443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2b16-bfdd-4f02-a1c3-f4523e29128a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.954837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2b16-bfdd-4f02-a1c3-f4523e29128a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.955363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:57.956036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.956318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.956560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 483/953] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:57.956673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.957410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:57.957719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:57.964579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:57.964754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:57.964754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:57.964754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:57.970790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 471/954] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:23:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:57.975240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:57.983528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:57.984975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:58.041423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.076568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 484/955] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:58.098526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.112810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e11f2-5e86-4e53-a2d3-17d06b2d93d1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.150979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.152212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.152706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.153189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.165443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.167240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.169393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:58.194416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:58.195712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:58.196613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:58.196613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:58.196613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:58.196613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:58.199174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 472/956] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:58.203311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.240956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2ec03-e6a0-4ccd-832d-e7b05c03c49c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.278902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.280185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.280678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.281177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.282052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.283673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:58.296146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:58.297217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:23:58.298081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:58.305918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 485/957] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:58.307606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.334271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3952412-fc73-4dd0-aad8-589a6d2f2617 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.360321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.374126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.375196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.375713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.376246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.377182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:58.377706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.379306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.400007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 473/958] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:58.400952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.426389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c3de9-9a28-489a-9e7a-1041a8f5b72d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.461401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.462042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.462327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.462614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.463342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:58.463932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.465016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f099-d642-495f-bf80-5a5c71656cd0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.469920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 486/959] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:58.471149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf54dc-9d52-413d-9b0a-f851af0eee6e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.471441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf54dc-9d52-413d-9b0a-f851af0eee6e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.471717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf54dc-9d52-413d-9b0a-f851af0eee6e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.475237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 487/960] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:58.475993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf54dc-9d52-413d-9b0a-f851af0eee6e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.479449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.525098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92689cf-1e52-40ed-8ecc-514d7565bd94 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.559294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.560041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.560333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.560617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.568135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.569573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.584418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf54dc-9d52-413d-9b0a-f851af0eee6e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-1077bf28-fe03-457d-a658-81e9e75522da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:23:58.584549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:58.585547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:58.586544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 474/961] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:58.587559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.587559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.587559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.596856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.606048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:58.607265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:58.625502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.626413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.626923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.627406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.628293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:58.628673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.630207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.647129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 488/962] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:58.647129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.697313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 475/963] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:23:58.723542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.791301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002cc1b-e2fc-4d97-8b82-071bba8b10ca None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.792646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.844001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.844701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.845057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.845537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.846180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:58.846487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.847965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.864717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf92974-eb9d-45bc-bef2-3743c10ce30d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:58.866569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 489/964] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:23:58.872593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:58.905006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:58.905815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:58.906095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:58.906371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:58.906793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:58.907022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:58.908543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:58.924088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:58.925370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:23:58.926405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:58.931143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 476/965] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:58.932515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.009893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b14e8-ae31-44d6-a545-5d2db468b540 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.037136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee15e5-8a6e-447e-96d1-84e75ab89cd1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.047277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:59.057655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.058519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.059367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.059665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.077458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.078756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.079657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.080185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.081125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:59.081648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.083940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.092330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 477/966] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:59.098208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.137907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.139521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.168418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:59.238902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd312-4b1b-47bb-a35f-a2f036089bc7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.251317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 490/967] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:23:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:23:59.257348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.291425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.292686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.293412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.294267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.295461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:59.295974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.298431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.305976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 478/968] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:23:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:59.312310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.353905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:59.403021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e15f49-6078-44ac-aefe-7f594b952db2 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.432050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aff21-b624-4cf8-92d5-5dcd130ac4cb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.440504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:59.452583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.454220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.454725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.455515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.469874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.470543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.470880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.471179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.471892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.472003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.473276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.473896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:23:59.494993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:59.497806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:59.498840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:23:59.498840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:23:59.498840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:23:59.498840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:23:59.498840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 491/969] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:23:59.502137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.560728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 479/970] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:23:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:23:59.624222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3002a-71e5-4d26-add6-39eb74b4635e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.693012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.694073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.694711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.695286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.696282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:23:59.696809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.698430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf32ea-609e-42b3-b401-548c2be6197a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.714414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 492/971] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:23:59.719968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.821031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:59.832375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b678-6d25-45fe-84b7-56cf8e6f69b1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:23:59.847824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3088b2-0892-4bba-a1b3-ed6334d2db6d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.848791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3088b2-0892-4bba-a1b3-ed6334d2db6d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.849171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3088b2-0892-4bba-a1b3-ed6334d2db6d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.851861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 493/972] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:23:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:23:59.857487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.858180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.859707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.872524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:23:59.873654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:23:59.874166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:23:59.874701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:23:59.881672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:23:59.882319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:23:59.882924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:23:59.883827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:23:59.901608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:23:59.902545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:23:59.903483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:23:59.904370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 480/973] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:23:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:23:59.909994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:23:59.924940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:23:59.970230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 494/974] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:23:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:23:59.995688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:00.031974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17862e42-bc94-4e1b-8c9a-2ccfc7d4c4b5 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:00.076417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:00.077696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.078371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.078826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.079951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:00.080416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:00.082701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:00.104486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 481/975] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:23:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:00.105907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:00.108890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3067f-3b62-4cb4-80d4-83a5aaf5226e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:00.122110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:00.155727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:00.156430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.156862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.157146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.158399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:00.160369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:00.162024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING keystone.server.flask.common [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 15:24:00.213110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82113215-4327-4225-9ed9-c9aa3d90c766 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:00.213764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.sql.core [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:24:00.213764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 15:24:00.213764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [parameters: {'user_id': '091c1d1e171b4a9692de869d9f1ae4fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 15:24:00.213764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80556) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application conn.query(q) May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result.read() May 23 15:24:00.235225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:24:00.236294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application next(self.gen) May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application yield resource May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application next(self.gen) May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise self.value May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application session.commit() May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:24:00.237403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.session.flush() May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application compat.raise_( May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:24:00.238312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:24:00.239209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application conn.query(q) May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application result.read() May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:24:00.246031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [parameters: {'user_id': '091c1d1e171b4a9692de869d9f1ae4fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:00.248060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 15:24:00.249962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 495/976] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 23 15:23:59 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:00.252275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:00.270431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:00.271741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.272285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.272858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.274447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] RBAC: Adding query filter params (role.id=2bc8445e24e44f379e0a777e8b0c3d4c, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=c9bdcccb57d14f44a4f93ced180dca4b) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:00.275083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:00.276948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:00.284176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 482/977] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:00 2022] GET /identity/v3/role_assignments?user.id=c9bdcccb57d14f44a4f93ced180dca4b&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=2bc8445e24e44f379e0a777e8b0c3d4c => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:00.286264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:00.383759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa8acc-49bb-4a52-9142-ee65cf64e060 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:00.426098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:00.427255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.427751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.428289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.437205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:00.439235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-6462aa25-15da-453b-b1f6-481b90fdef19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:24:00.456261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:00.457388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:24:00.458338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:00.460898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 496/978] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:00.468477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:00.553179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:00.576263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2771-3481-42ca-a68e-7ba79eab99ca None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:00.612875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:00.613557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.613841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.614120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.614932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:00.615263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:00.616682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447d0c2-dd9f-42f4-9636-0c6a1f01da6e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:00.653090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 483/979] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 23 15:24:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:00.960538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d2ba-c296-4f02-a71a-f790607de127 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.961094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d2ba-c296-4f02-a71a-f790607de127 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.961174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30d2ba-c296-4f02-a71a-f790607de127 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.965480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 497/980] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:00.970907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da62cfb-f8fc-4f67-adbf-d6983a6e3e09 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:00.971380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da62cfb-f8fc-4f67-adbf-d6983a6e3e09 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:00.971571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da62cfb-f8fc-4f67-adbf-d6983a6e3e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:00.988310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9da62cfb-f8fc-4f67-adbf-d6983a6e3e09 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:00.989473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9da62cfb-f8fc-4f67-adbf-d6983a6e3e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:01.060904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 484/981] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:01.083406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30d2ba-c296-4f02-a71a-f790607de127 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:01.172998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:01.186437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30d2ba-c296-4f02-a71a-f790607de127 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:01.222321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092202d-3c48-415b-9ad6-1f88c9264ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:01.222905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092202d-3c48-415b-9ad6-1f88c9264ab1 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:01.223212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092202d-3c48-415b-9ad6-1f88c9264ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:01.223487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092202d-3c48-415b-9ad6-1f88c9264ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:01.224221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092202d-3c48-415b-9ad6-1f88c9264ab1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:01.225839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092202d-3c48-415b-9ad6-1f88c9264ab1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:01.289154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 498/982] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:24:01 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:01.943003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e921-fc27-4cb8-801f-52b3fcdecfe9 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:01.943405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e921-fc27-4cb8-801f-52b3fcdecfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:01.943603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e921-fc27-4cb8-801f-52b3fcdecfe9 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:01.945596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 485/983] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:01.951204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:01.951505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:01.951790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:01.969055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:01.970555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:02.045901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 499/984] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:02.068674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e921-fc27-4cb8-801f-52b3fcdecfe9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:02.134018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:02.174018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416e921-fc27-4cb8-801f-52b3fcdecfe9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:02.208384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:02.209107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.209387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.209658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.210301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:02.212181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:02.224254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:02.225483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:02.232139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 486/985] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:02.234309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:02.313179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:02.337678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8a69-5cac-4891-bf47-6baf03d1f365 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:02.372185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:02.372850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.373133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.373406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.374119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:02.374427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:02.375839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:02.382058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 500/986] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:02.386777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:02.498562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046e185-65f6-496f-b868-708bc5d68010 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:02.528598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:02.536879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:02.537553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.537841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.540798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.540798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:02.540798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:02.541127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7353ceb-3cf9-48c0-9eb8-b1b5acfa06f1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:02.546178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 487/987] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:02.555119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:02.603272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e6798-b342-4851-8111-747c4d7c341d None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.603565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e6798-b342-4851-8111-747c4d7c341d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.603873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e6798-b342-4851-8111-747c4d7c341d None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.605384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 488/988] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:24:02.612106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.612400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.612687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.629809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:02.631005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:02.656966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4d13-76af-4611-8c73-3253d8fcfaaa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:02.693153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:02.693813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.694099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.694376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.695224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] RBAC: Adding query filter params (interface=admin, service_id=d358410973964496acf6590ee91b7bf6, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:02.695539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:02.696908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:02.700586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 489/989] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:02.704763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 501/990] 10.222.0.32 () {56 vars in 1249 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/endpoints?service_id=d358410973964496acf6590ee91b7bf6&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:02.710248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:02.724411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:02.728211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:02.816534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8f84-051c-4bcb-a7c0-b7db83d584b1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:02.829268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbe8f3-a672-48f1-9a30-3f8350cd27c5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:02.841816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:02.855285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:02.856391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.856928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.857344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.858170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:02.860004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:02.864246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:02.865038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:02.865324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:02.865605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] PATH_INFO: `/v3/services/image` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:02.866262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:02.868229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:02.868616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 490/991] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:02.890236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:02.891468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:02.894878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 502/992] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:02.898474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:03.010788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357ed5-e7b3-42e6-8d31-ad251574a0aa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:03.046678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:03.047849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:03.047849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:03.047849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:03.048483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] RBAC: Adding query filter params (name=image) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:03.048790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:03.050154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef0de-e7c9-43a0-9da1-b82bc5224b27 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:03.056470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 491/993] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:03.061881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:03.131411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:03.165497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1489d0-f78d-4bd9-8d6d-d72aa7b55847 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:03.201675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:03.202342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:03.202624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:03.202898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:03.203646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:03.203956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:03.205325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3deb-08ff-40f4-a51e-9201e0153df1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:03.216596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 503/994] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:03.563712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0936-ea0d-41ae-b719-13f9380c411e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:03.564237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0936-ea0d-41ae-b719-13f9380c411e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:03.564347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0936-ea0d-41ae-b719-13f9380c411e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:03.565783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 492/995] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:03.570849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:03.571172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:03.571461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:03.588271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:03.589468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:03.658072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 504/996] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:03.681531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c0936-ea0d-41ae-b719-13f9380c411e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:03.743156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:03.793702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c0936-ea0d-41ae-b719-13f9380c411e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:03.826534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:03.827313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:03.827601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:03.827882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:03.828535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:03.829887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:03.841934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:03.842906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:03.843953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 493/997] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:24:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:03.849095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:03.911127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:03.952041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b56f27-cfc9-4794-820b-00a217d57540 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:03.986945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:03.987645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:03.987932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:03.988212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:03.988926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:03.989281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:03.990662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:04.000032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 505/998] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:24:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:04.001225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:04.104697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21863f-65a1-4c61-9f2a-74cf146a9cfd None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:04.118951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:04.138457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:04.139469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:04.139931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:04.140391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:04.141271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:04.141753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:04.143318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:04.148429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 494/999] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:24:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:04.154225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:04.259592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da565a-2d44-41f4-8dc4-f38daa52edc6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:04.283451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:04.294401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:04.295054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:04.295361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:04.295634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:04.298449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] RBAC: Adding query filter params (interface=public, service_id=83bc64d18aa7432398e4d47a526ee121, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:04.298449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:04.298449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a922-3011-4a3f-ab61-97f0797d96a3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:04.303189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 506/1000] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:24:04 2022] GET /identity/v3/endpoints?service_id=83bc64d18aa7432398e4d47a526ee121&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:04.309138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:04.415182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de56d34-979d-4d0d-b95c-d316ab108d35 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:04.450892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c563be-68cf-4268-8680-ac30a18bd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:04.451609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c563be-68cf-4268-8680-ac30a18bd403 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:04.451897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c563be-68cf-4268-8680-ac30a18bd403 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:04.452181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c563be-68cf-4268-8680-ac30a18bd403 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:04.452871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c563be-68cf-4268-8680-ac30a18bd403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:04.454236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c563be-68cf-4268-8680-ac30a18bd403 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:04.461270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 495/1001] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:24:04 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:24:05.125711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edd4a-2933-43fa-8df4-716cb2980357 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.126163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edd4a-2933-43fa-8df4-716cb2980357 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.126668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edd4a-2933-43fa-8df4-716cb2980357 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.129194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 507/1002] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:05.134818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.135324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.135403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.152481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:05.153689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:05.192093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:05.224127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 496/1003] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:05.247948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942edd4a-2933-43fa-8df4-716cb2980357 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:05.357301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942edd4a-2933-43fa-8df4-716cb2980357 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:05.391411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:05.392141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.392477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.392760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.393413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:05.394789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c9ba9253-4d92-4412-84ed-2b9b460c98a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:05.407351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:05.408318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:24:05.409158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:05.410643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 508/1004] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 23 15:24:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:05.415116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:05.461759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74a46-1048-4ba9-a90d-a55228119cf5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.462107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74a46-1048-4ba9-a90d-a55228119cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.462329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f74a46-1048-4ba9-a90d-a55228119cf5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.464062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 509/1005] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:24:05.468780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.469066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.469346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.487492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:05.489296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:05.531377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5bea8-3a11-4cd9-8774-8d7aae0d2e78 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:05.546540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:05.569102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:05.569792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.570592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.570876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.571692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:05.572005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:05.573438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:05.575274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 510/1006] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:05.579646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 497/1007] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:24:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:05.585315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:05.590382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:05.628914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:05.691790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94843d-df62-41af-b0ee-56de6dea7072 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:05.701292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d5d6-43bb-4f58-b842-20641499de3b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:05.730121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:05.731073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.731614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.732105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.733055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:05.733549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:05.735004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:05.736772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ef87-6c4a-40ec-9308-fb06340c47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:05.737441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ef87-6c4a-40ec-9308-fb06340c47a7 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.737729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ef87-6c4a-40ec-9308-fb06340c47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.738011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ef87-6c4a-40ec-9308-fb06340c47a7 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.738738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ef87-6c4a-40ec-9308-fb06340c47a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:05.740152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ef87-6c4a-40ec-9308-fb06340c47a7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:05.740565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 511/1008] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 23 15:24:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:05.745834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:05.794880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:05.814693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 498/1009] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:24:05 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:05.853586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f151f7-1ba0-4ba0-b22b-ac73a662d2f8 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:05.900183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a3ea-b6b2-40fb-9954-e8b720a377c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:05.900854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a3ea-b6b2-40fb-9954-e8b720a377c3 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:05.901134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a3ea-b6b2-40fb-9954-e8b720a377c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:05.901404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a3ea-b6b2-40fb-9954-e8b720a377c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:05.902244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6a3ea-b6b2-40fb-9954-e8b720a377c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:05.903741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6a3ea-b6b2-40fb-9954-e8b720a377c3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:05.975838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 512/1010] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:24:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:24:06.674642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687910-a4f9-4e3d-9af5-95837d0d29ee None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:06.675162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687910-a4f9-4e3d-9af5-95837d0d29ee None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:06.675162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687910-a4f9-4e3d-9af5-95837d0d29ee None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:06.676543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 499/1011] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:06.682411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:06.682820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:06.683040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:06.699805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:06.700995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:06.774049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 513/1012] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:06 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:06.796792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2687910-a4f9-4e3d-9af5-95837d0d29ee None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:06.891446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:06.898852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2687910-a4f9-4e3d-9af5-95837d0d29ee None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:06.931271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:06.931995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:06.932280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:06.932559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:06.933439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:06.934930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:06.947552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:06.948686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:24:06.949549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:06.951031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 500/1013] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:24:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:06.955277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:06.984568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:07.057101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4c4d-903e-4030-9888-3b366f155b30 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.098674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.100131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.100646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.101137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.102081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:07.102600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.104303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.110775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 514/1014] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:24:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:07.120187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.276037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b588f0c-c737-4c21-9ffc-ac18dfc4029c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.313620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.317544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.317544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.317544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.317544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] RBAC: Adding query filter params (type=compute) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:07.317544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.317544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85606b1e-217a-4b3b-aebc-14ede7f08fed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.322756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 501/1015] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 23 15:24:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:07.328267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.432578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:07.441056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aeaaa-bd0c-42b7-a0cd-5a9d6d3901ed None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.486267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a507533-c394-412f-8279-9cf1e43ee363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.486852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507533-c394-412f-8279-9cf1e43ee363 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.487155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507533-c394-412f-8279-9cf1e43ee363 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.487431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507533-c394-412f-8279-9cf1e43ee363 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.488183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a507533-c394-412f-8279-9cf1e43ee363 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.489567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a507533-c394-412f-8279-9cf1e43ee363 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.581488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 515/1016] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:08.069230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f09150-2e50-4754-9c91-86dd39fc6df3 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.069752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f09150-2e50-4754-9c91-86dd39fc6df3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.070098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f09150-2e50-4754-9c91-86dd39fc6df3 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.071471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 502/1017] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:08.076590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b623ce-7e1f-4a90-b3cb-9bfe4056117e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.076995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b623ce-7e1f-4a90-b3cb-9bfe4056117e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.077154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b623ce-7e1f-4a90-b3cb-9bfe4056117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.093551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-91b623ce-7e1f-4a90-b3cb-9bfe4056117e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:08.094711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-91b623ce-7e1f-4a90-b3cb-9bfe4056117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:08.166808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 516/1018] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:08.189207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f09150-2e50-4754-9c91-86dd39fc6df3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.215444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.222672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4fe59-f579-4175-a3a1-b886112cead1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.222961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4fe59-f579-4175-a3a1-b886112cead1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.223286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4fe59-f579-4175-a3a1-b886112cead1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.229150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 517/1019] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:08.230991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.231516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.231953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.249180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:08.250372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:08.302570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f09150-2e50-4754-9c91-86dd39fc6df3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.331470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 518/1020] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:08.338350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.339172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.339457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.339730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.340378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.341726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.345572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.349428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:08.354049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:08.355039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:08.362351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 503/1021] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:08.363215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.453556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.461752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a319d6-18ed-4596-b76a-7ed9a039206f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.466191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105496-c706-46ba-879b-db76444ef5e2 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.498788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.499618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.499896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.500172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.501373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.502579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.502776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.503281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.503572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.503854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.504583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 519/1022] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:08.507297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] RBAC: Adding query filter params (name=image) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:08.507665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.509248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.510054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.515337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 504/1023] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:08.521123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.582017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.613318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935355-40c2-4175-9f1b-96dc060c486e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.631352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a1e3-3e01-4e00-8c85-9c5073698b27 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.649216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.650115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.650476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.650937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.651804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.653253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.668297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.668944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.669233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.669532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.670226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] RBAC: Adding query filter params (type=image) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:08.670541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.671910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.676846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 505/1024] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:08.682591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.700925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.736087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 520/1025] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:24:08 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:24:08.789459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cfa18-60bb-48b3-810e-9da522e14831 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.828612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.829293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.829581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.829861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.830670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] RBAC: Adding query filter params (interface=public, service_id=2fac45623aac4551abad72a9506610ba, region_id=RegionOne) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:08.830989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.832478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d48c0-73e7-4307-8044-9191cfcfb9cb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.838473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 506/1026] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/endpoints?service_id=2fac45623aac4551abad72a9506610ba&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:08.847152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.954398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48368459-9fa6-4157-8c21-712bb9d0538e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.978787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.989221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e5f0-56b2-4977-bb17-f02732e84469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.989894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e5f0-56b2-4977-bb17-f02732e84469 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.990186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e5f0-56b2-4977-bb17-f02732e84469 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.990467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e5f0-56b2-4977-bb17-f02732e84469 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.991198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e5f0-56b2-4977-bb17-f02732e84469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.992607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e5f0-56b2-4977-bb17-f02732e84469 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.999440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 521/1027] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:24:09.907448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa03e-61d2-44fe-b082-22e28f52a6b3 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:09.907985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa03e-61d2-44fe-b082-22e28f52a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:09.908092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa03e-61d2-44fe-b082-22e28f52a6b3 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:09.909641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 507/1028] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:09.915327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:09.915847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:09.915924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:09.933825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:09.935034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:10.007500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 522/1029] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:10.030833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa03e-61d2-44fe-b082-22e28f52a6b3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:10.113766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:10.134120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa03e-61d2-44fe-b082-22e28f52a6b3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:10.172269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:10.173358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:10.173819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:10.174286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:10.185105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:10.193555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:10.194500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:24:10.195426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:10.197429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 508/1030] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 23 15:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:10.203503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:10.314713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5077b-09a5-48d6-92ed-7e65bcc8cf1a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:10.332080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:10.348379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:10.349591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:10.349591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:10.350002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:10.350656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:10.350962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:10.352887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:10.362082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 523/1031] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:10.366611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:10.466105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b02b-df7e-4fe8-a355-014f88ed240e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:10.499843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:10.500630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:10.500914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:10.501188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:10.510425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:10.513138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:10.514571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:10.531883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:10.532862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:10.533827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:10.533827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:10.533827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:10.533827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:10.534592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 509/1032] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:10.539145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:10.653691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8641ad-b68f-444d-8acc-d77c786ad732 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:10.690501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:10.691191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:10.691477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:10.691753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:10.692476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:10.692783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:10.694233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:10.707166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 524/1033] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:10.712583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:10.816359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6fdfc-d601-47a0-918e-634698ce2eb6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:10.852487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:10.853307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:10.853587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:10.853862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:10.862803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:10.864313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-de390788-bf9b-4c32-9b6d-def26c345336 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:24:10.879714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:10.880813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:24:10.881825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:10.883588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 510/1034] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:10.887137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:10.931852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:10.990165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47749079-2906-4832-883d-853b1a9cbce5 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.025393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.026087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.026371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.026645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.027540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:11.027853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.029373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.042842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528e978-cb91-433f-85c2-d15153b3f5f6 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.043428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528e978-cb91-433f-85c2-d15153b3f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.043428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528e978-cb91-433f-85c2-d15153b3f5f6 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.045027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 511/1035] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:24:11.053927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 525/1036] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:24:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:11.054123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.054123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.054123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.055289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.070459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:11.071686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:11.119658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.141301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 512/1037] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:11.158056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.162051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2551e-8ca8-42af-95ee-580b560d393c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.166741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.198391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358b71-1133-48f6-b932-7f7c85a49dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.199038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358b71-1133-48f6-b932-7f7c85a49dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.199413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358b71-1133-48f6-b932-7f7c85a49dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.199660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358b71-1133-48f6-b932-7f7c85a49dd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.268717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57c40-4e65-4e98-8732-dc89f1c63674 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.273945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358b71-1133-48f6-b932-7f7c85a49dd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.275451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358b71-1133-48f6-b932-7f7c85a49dd3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.302944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6b398-f16e-487a-92c4-d267ae34da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.303921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b398-f16e-487a-92c4-d267ae34da42 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.304541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b398-f16e-487a-92c4-d267ae34da42 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.304824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b398-f16e-487a-92c4-d267ae34da42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.305989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6b398-f16e-487a-92c4-d267ae34da42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.307433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6b398-f16e-487a-92c4-d267ae34da42 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.309047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 513/1038] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:11.310294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b2f3-9e38-4c6c-8b9f-2f34e6950ac1 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.310582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b2f3-9e38-4c6c-8b9f-2f34e6950ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.310861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b2f3-9e38-4c6c-8b9f-2f34e6950ac1 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.314887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 514/1039] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:11.314887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b2f3-9e38-4c6c-8b9f-2f34e6950ac1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.363776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.371618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.376178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 526/1040] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:11.386858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.386858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.386858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.394071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:11.395337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:11.413727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b2f3-9e38-4c6c-8b9f-2f34e6950ac1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.446951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.447642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.447920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.448195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.448919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.450298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.461066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 527/1041] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:11.461692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.556917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 515/1042] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:24:11 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:24:11.557915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.561984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bcc0d-0cf2-4df0-aa64-57e3eddfdba4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.594154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.604956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.606150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.606440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.606719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.618716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.620200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:11.639681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:11.640700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:11.641654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:11.641654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:11.641654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:11.641654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:11.642357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 528/1043] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:11.647673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.680122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdefff-21ef-4300-9bdc-dc3db23ab64e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.690123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.720730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.721859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.722369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.722943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.724042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.725881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:11.738873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:11.742396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:11.748431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 516/1044] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:11.749697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.761987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d8f85-3a41-4e5e-8c83-a243675d9f9c None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.803861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.807324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.807781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.808403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.809331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:11.809799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.811546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.823369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 529/1045] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:11.829288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.874957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.881416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc729-6e9b-4a45-9c2a-117d8f3d4bd0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.917002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.917676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.917966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.918251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.918965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] RBAC: Adding query filter params (name=image) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:11.919307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.920670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:11.926023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 517/1046] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:11.935432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64561a4b-62c2-4ea0-b6e1-66acc825df83 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:11.936057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:11.975984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:11.979762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:11.980561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:11.980839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:11.981110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:11.988729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:11.990195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:24:12.005281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:12.006217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:12.011908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 530/1047] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:12.012419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:12.055090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707342-b147-4422-969a-e33c53636dbe None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:12.091534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:12.092188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:12.092591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:12.092870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:12.093700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] RBAC: Adding query filter params (type=image) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:12.094009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:12.095492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:12.106158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 518/1048] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:12.107138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:12.113208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:12.120860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4372e50-40be-4a06-be43-cd41b15aad71 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:12.156123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:12.156702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:12.156983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:12.157256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:12.158043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:12.158350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:12.159824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:12.171830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 531/1049] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:12.177894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:12.213400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:12.217113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08061c91-4ebb-45fb-9605-214c6902e798 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:12.260309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0de89-0cd0-4c3a-9b49-2151cea1a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:12.261006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0de89-0cd0-4c3a-9b49-2151cea1a463 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:12.261298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0de89-0cd0-4c3a-9b49-2151cea1a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:12.261689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0de89-0cd0-4c3a-9b49-2151cea1a463 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:12.262468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0de89-0cd0-4c3a-9b49-2151cea1a463 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:12.264015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0de89-0cd0-4c3a-9b49-2151cea1a463 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:12.285484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912cda2-31fb-471a-b319-b8ce62260847 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:12.318552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:12.319227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:12.319512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:12.320282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:12.321169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] RBAC: Adding query filter params (role.id=2bc8445e24e44f379e0a777e8b0c3d4c, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=6867f7729ddf465ca6d31df087c00881) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:12.321484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:12.322902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc236d26-0108-453d-9aec-10f64d0086c9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:12.328233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 532/1050] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:12 2022] GET /identity/v3/role_assignments?user.id=6867f7729ddf465ca6d31df087c00881&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=2bc8445e24e44f379e0a777e8b0c3d4c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:12.395124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 519/1051] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:24:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:13.825867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05da5a-85fb-49ec-8f20-a5d7d80a86a7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:13.826410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05da5a-85fb-49ec-8f20-a5d7d80a86a7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:13.826410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05da5a-85fb-49ec-8f20-a5d7d80a86a7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:13.827932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 533/1052] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:13.833608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:13.834031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:13.834211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:13.850981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:13.852710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:13.925801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 520/1053] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:13.948128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05da5a-85fb-49ec-8f20-a5d7d80a86a7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:13.973724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:14.051881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05da5a-85fb-49ec-8f20-a5d7d80a86a7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:14.085498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:14.086230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.086513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.086788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.097000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:14.105382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:14.106336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:14.112148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 534/1054] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:14.114324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:14.195131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:14.214430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eefd0-0ed7-419b-aea3-ffaa25ac0a15 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:14.257096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:14.257980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.258266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.258544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.259316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:14.259628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:14.260997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:14.274875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 521/1055] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:14.276159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:14.366702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:14.383087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570927a2-3c7d-4542-9051-e5d89a1b35aa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:14.418036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec2feb-f534-4768-a12d-3e1e576fc49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:14.418900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec2feb-f534-4768-a12d-3e1e576fc49a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.419208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec2feb-f534-4768-a12d-3e1e576fc49a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.419482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec2feb-f534-4768-a12d-3e1e576fc49a None admin] PATH_INFO: `/v3/users/d40ac2451116437c96de21851bc2e314` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.433988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec2feb-f534-4768-a12d-3e1e576fc49a None admin] RBAC: Authorizing `identity:get_user(user_id=d40ac2451116437c96de21851bc2e314)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:14.435464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec2feb-f534-4768-a12d-3e1e576fc49a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:14.438265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 535/1056] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:14 2022] GET /identity/v3/users/d40ac2451116437c96de21851bc2e314 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:14.443027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:14.532703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4ec8-dbcf-4811-a281-17406111c1b1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.533047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4ec8-dbcf-4811-a281-17406111c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.533271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4ec8-dbcf-4811-a281-17406111c1b1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.534660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 536/1057] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:14.540891 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604f2c-2613-4d6a-a2fe-9ef2cacfa421 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.541177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604f2c-2613-4d6a-a2fe-9ef2cacfa421 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.541450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604f2c-2613-4d6a-a2fe-9ef2cacfa421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.549851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ea5a-5b30-4f33-950d-58ace8a617ac None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:14.557880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-13604f2c-2613-4d6a-a2fe-9ef2cacfa421 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:14.559139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-13604f2c-2613-4d6a-a2fe-9ef2cacfa421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:14.584623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f727-b108-485f-bc0a-b2f3cec4c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:14.585268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f727-b108-485f-bc0a-b2f3cec4c34e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.586178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f727-b108-485f-bc0a-b2f3cec4c34e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.586460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f727-b108-485f-bc0a-b2f3cec4c34e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.600940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:14.630729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 537/1058] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:14.647603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c04b-3e62-4bf1-945c-18eca9f12014 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.647951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c04b-3e62-4bf1-945c-18eca9f12014 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.648238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761c04b-3e62-4bf1-945c-18eca9f12014 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.649595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 538/1059] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:24:14.653873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c04b-3e62-4bf1-945c-18eca9f12014 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:14.661432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78f727-b108-485f-bc0a-b2f3cec4c34e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:14.662870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78f727-b108-485f-bc0a-b2f3cec4c34e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:14.829514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:14.860749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 522/1060] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:24:14.861274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761c04b-3e62-4bf1-945c-18eca9f12014 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:14.862058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843656d-e072-4028-8879-9d9c3984321a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.862354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843656d-e072-4028-8879-9d9c3984321a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.862637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843656d-e072-4028-8879-9d9c3984321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.878446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b843656d-e072-4028-8879-9d9c3984321a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:14.879674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b843656d-e072-4028-8879-9d9c3984321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:14.898901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:14.899676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:14.899959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:14.900232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:14.910163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:14.914964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:14.918298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:14.919505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:14.920373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 539/1061] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 23 15:24:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:14.921076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:14.949779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 523/1062] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:14.950658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843656d-e072-4028-8879-9d9c3984321a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.033497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b305ab-98a8-4973-ab0b-9302eff51fa9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.047729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843656d-e072-4028-8879-9d9c3984321a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.062589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.067740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.068598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.068883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.069168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.070926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] RBAC: Authorizing `identity:get_project(project_id=5b2509c6aa8649bc995492af3aec1bf7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.072401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.076829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 540/1063] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:14 2022] GET /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:15.076829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.082187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.082858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.083173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.083453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.084196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:15.084540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.085932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.093929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 524/1064] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:24:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:15.094702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.128329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.183177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58464d-ad23-484b-8693-e6dca9d3a69e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.193004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272363e-a42a-497e-a2a4-f11013907bb5 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.219047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.219714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.219995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.220267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.226421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.227071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.227391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.227671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.228507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=5b2509c6aa8649bc995492af3aec1bf7, user.id=d40ac2451116437c96de21851bc2e314) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:15.229032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.230237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.238679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 525/1065] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/role_assignments?user.id=d40ac2451116437c96de21851bc2e314&scope.project.id=5b2509c6aa8649bc995492af3aec1bf7&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:15.239547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.301201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.305000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.306494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.360386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.363960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5072-327d-4d1a-a4a8-2eafa430b2a7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.403326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.404137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.404417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.404698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.415828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.417282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.421872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 541/1066] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:15.427809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:15.435859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:15.436753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:15.437670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:15.437670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:15.437670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:15.437670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:15.437670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 526/1067] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:15.444529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.535543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.538943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6716b-5eb3-4bdb-8e3f-e24d0263f927 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.552277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d251-3cd8-4360-a793-798b8cea92d9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.586641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.587466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.587748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.588024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.591305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.592172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.592637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.593110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.594026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:15.594742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.596569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.598043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.599525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.610696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 527/1068] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:15.616174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:15.622029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:15.623071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:15.624028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:15.624028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:15.624028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:15.624028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:15.624028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 542/1069] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:15.628999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.629130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.727616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb833b2-1e62-4633-8237-9bfa535e5856 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.744610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ed71-5d2c-45b1-aeb9-0064c4a15634 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.764011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.766170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.766170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.766170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.773192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.774630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.785190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.785858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.786143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.786424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.787181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:15.787494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.788901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:24:15.789080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:15.790006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:15.791172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 528/1070] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:15.795928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:15.803592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 543/1071] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:15.882178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:15.918586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c05441-432a-4128-be74-f73cc2dcae04 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:15.955635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:15.956333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:15.956619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:15.956902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:15.957762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:15.958081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:15.959581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:15.979835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 529/1072] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:15.985647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:16.002269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:16.095857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426095b-34be-4802-a28d-c396f3d00933 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:16.130542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:16.131380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:16.131662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:16.131941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:16.143164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:16.144629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:16.161649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:16.162676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:16.163664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:16.163664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:16.163664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:16.163664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:16.163664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 544/1073] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:16.168592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:16.268096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea04f0-f0b3-40c8-8ce9-a9336db2ec09 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:16.293648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:16.301320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:16.306127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:16.306127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:16.306127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:16.306127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:16.306127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:16.306127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:16.323226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 530/1074] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:16.329031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:16.392246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:16.430023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84c37-665e-47fc-9a7f-d26b7b91591d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:16.462866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:16.463687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:16.463973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:16.464250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:16.470780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:16.472270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:24:16.486349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:16.487334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:16.488540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 545/1075] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:16.493739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:16.589571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb6a6a-3a04-4e98-8e7e-7063c1b056f0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:16.624383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:16.625048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:16.625330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:16.625606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:16.626389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:16.626701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:16.628151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0743b7-99e4-42f0-b75d-8c3ea0218d9d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:16.640734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 531/1076] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:16.646691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:16.743796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdfe6b-5512-4ee4-84ec-56308b390da1 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:16.767055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:16.777388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8a001-98a5-4a74-bdf3-151ffd3f2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:16.781996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8a001-98a5-4a74-bdf3-151ffd3f2d57 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:16.781996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8a001-98a5-4a74-bdf3-151ffd3f2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:16.781996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8a001-98a5-4a74-bdf3-151ffd3f2d57 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/6867f7729ddf465ca6d31df087c00881/roles/2bc8445e24e44f379e0a777e8b0c3d4c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:16.781996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8a001-98a5-4a74-bdf3-151ffd3f2d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=6867f7729ddf465ca6d31df087c00881, role_id=2bc8445e24e44f379e0a777e8b0c3d4c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:16.782476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8a001-98a5-4a74-bdf3-151ffd3f2d57 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:16.853050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 546/1077] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:24:16 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/6867f7729ddf465ca6d31df087c00881/roles/2bc8445e24e44f379e0a777e8b0c3d4c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:24:17.451633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b3a71-32ae-4392-ace9-26068deb363d None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:17.452155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b3a71-32ae-4392-ace9-26068deb363d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:17.452260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b3a71-32ae-4392-ace9-26068deb363d None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:17.453576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 532/1078] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:17.459041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:17.459492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:17.459633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:17.476051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:17.477216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:17.541629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 547/1079] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:17.564045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b3a71-32ae-4392-ace9-26068deb363d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:17.613429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:17.663201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b3a71-32ae-4392-ace9-26068deb363d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:17.696908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:17.697692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:17.697973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:17.698246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:17.707978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:17.715702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:17.716804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:17.717760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 533/1080] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:17.722832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:17.818780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb040c-5339-4a35-9231-55191a80316c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:17.832328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:17.852511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:17.853172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:17.853457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:17.853734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:17.854480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:17.854788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:17.856189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:17.864440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 548/1081] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:17.870629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:17.970857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f81b6-8411-4d81-b48b-dfe0ae3fe7c5 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:17.980815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:18.004543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:18.005412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:18.005693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:18.006267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] PATH_INFO: `/v3/users/d40ac2451116437c96de21851bc2e314` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:18.007498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] RBAC: Authorizing `identity:get_user(user_id=d40ac2451116437c96de21851bc2e314)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:18.008908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:18.010543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 534/1082] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:17 2022] GET /identity/v3/users/d40ac2451116437c96de21851bc2e314 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:18.016263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:18.118048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcb3dd-5120-4918-aa92-d76c0caa4ec4 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:18.149970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390acc49-a65a-4fc6-ac6b-6bbdb0c83824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:18.150901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acc49-a65a-4fc6-ac6b-6bbdb0c83824 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:18.151221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acc49-a65a-4fc6-ac6b-6bbdb0c83824 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:18.151501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acc49-a65a-4fc6-ac6b-6bbdb0c83824 None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:18.152686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390acc49-a65a-4fc6-ac6b-6bbdb0c83824 None admin] RBAC: Authorizing `identity:get_project(project_id=5b2509c6aa8649bc995492af3aec1bf7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:18.154150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390acc49-a65a-4fc6-ac6b-6bbdb0c83824 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:18.155917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 549/1083] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:18 2022] GET /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:18.161746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:18.263287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6b844-7f20-441d-8b34-da4629172851 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:18.296173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9764217-0217-4360-ac7f-7897c560d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:18.297041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9764217-0217-4360-ac7f-7897c560d3b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:18.297320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9764217-0217-4360-ac7f-7897c560d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:18.297589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9764217-0217-4360-ac7f-7897c560d3b4 None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7/users/d40ac2451116437c96de21851bc2e314/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:18.299539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9764217-0217-4360-ac7f-7897c560d3b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b2509c6aa8649bc995492af3aec1bf7, user_id=d40ac2451116437c96de21851bc2e314, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:18.300949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9764217-0217-4360-ac7f-7897c560d3b4 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:18.385791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 535/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:24:18 2022] PUT /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7/users/d40ac2451116437c96de21851bc2e314/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:24:19.050889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20610fa8-0d6b-454d-80de-9e3bcaa02b59 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.051451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20610fa8-0d6b-454d-80de-9e3bcaa02b59 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.051451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20610fa8-0d6b-454d-80de-9e3bcaa02b59 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.052841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 550/1085] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:19.058870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.059285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.059462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.076390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:19.077569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:19.106203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:19.142977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 536/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:19.166882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20610fa8-0d6b-454d-80de-9e3bcaa02b59 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:19.212394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:19.267366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20610fa8-0d6b-454d-80de-9e3bcaa02b59 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:19.299597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:19.300395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.300676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.301002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.311240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:19.319276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:19.320341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:19.326174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 551/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 23 15:24:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:19.328359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:19.423261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e428-4ec2-4c54-b49d-eaec0bff92a0 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:19.456122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:19.456822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.457105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.457382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.458139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:19.458446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:19.459872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:19.474219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 537/1088] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:24:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:19.475707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:19.574470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43bf2-d1d5-40b6-bef4-3d79efe88833 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:19.576761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:19.618628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:19.619448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.619733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.620008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.630578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:19.632082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:19.649028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:19.649931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:19.650811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:19.650811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:19.650811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:19.650811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:19.650811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 552/1089] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:19.656007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:19.684963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:19.754520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33716a7a-7320-425c-857d-09e16faec8c7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:19.786883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:19.787574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.787863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.788145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.788911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:19.789220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:19.791149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:19.802109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 538/1090] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:19.807696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:19.906741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebbb8-a7c0-4db0-b902-2f5b3078e07d None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:19.938640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:19.939461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:19.939742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:19.940020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:19.948869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:19.950305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:24:19.964399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:19.965510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:19.966503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 553/1091] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 23 15:24:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:19.971567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.058008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.069081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd003-d2e3-4213-878a-8d60093558ed None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.103041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.103732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.104016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.104292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.105118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:20.105418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:20.106822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:20.133277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 539/1092] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 23 15:24:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:20.134922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.153435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.231829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6ada4-43a3-4261-abf7-cc51f15bf7be None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.268221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415232ce-33c5-42bf-9669-e5f423d457c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.268859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415232ce-33c5-42bf-9669-e5f423d457c0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.269141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415232ce-33c5-42bf-9669-e5f423d457c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.269416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415232ce-33c5-42bf-9669-e5f423d457c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.360738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415232ce-33c5-42bf-9669-e5f423d457c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:20.362219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415232ce-33c5-42bf-9669-e5f423d457c0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:20.381298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.468612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 554/1093] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:20.469855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.562854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c7f6-cc53-4f28-9355-d48a1acca376 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.563188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c7f6-cc53-4f28-9355-d48a1acca376 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.563541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c7f6-cc53-4f28-9355-d48a1acca376 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.564990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 555/1094] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:24:20.567397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876971a7-f410-4c9e-ab08-726edb8cdf1c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.570432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.570719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.570996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.588271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:20.589555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:20.602715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.607001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.607352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.607637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.620752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:20.627550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:20.629808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:20.641735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:20.642702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:20.643642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:24:20.643642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:20.643642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:24:20.643642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:20.643642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 540/1095] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:20.649206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.665054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 556/1096] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:20.688697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.733792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.751193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706828a4-874d-4112-97b6-a9bc4e00ee43 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.784630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.785297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.785579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.785859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.786578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:20.786887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:20.786985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c053d-499e-4641-9995-69a15ad6c1bf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.788299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:20.799737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 541/1097] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:20.805285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.820736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.821460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.821742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.822016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.832680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:20.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:20.841642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:20.842499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 557/1098] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:20.847807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.862672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.903430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea04f4-835c-46c7-b7ee-c406c7412531 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.936205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.936988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.937270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.937546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.944009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:20.946023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:20.946225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78930c2-8f8b-41b5-b808-1bea228a1e47 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:20.953393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:24:20.960590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:20.961656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:20.962818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 542/1099] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:20.967852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:20.981455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:20.982132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:20.982413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:20.982713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:20.983512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:20.983973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:20.985378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:20.999919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 558/1100] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:21.000895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:21.072202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d9f1-3241-4ec6-8ebb-e46dd858fb04 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:21.090452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:21.098511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e6be-62be-4668-bce1-dfb938432a4e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:21.106637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:21.107326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:21.107616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:21.107894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:21.108674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:21.108984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:21.110469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:21.122563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 543/1101] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:21.128186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:21.132211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:21.133595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:21.133877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:21.134153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] PATH_INFO: `/v3/users/d40ac2451116437c96de21851bc2e314` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:21.135378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] RBAC: Authorizing `identity:get_user(user_id=d40ac2451116437c96de21851bc2e314)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:21.136800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:21.138412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 559/1102] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:21 2022] GET /identity/v3/users/d40ac2451116437c96de21851bc2e314 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:21.143910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:21.177538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:21.223541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2201f4c-d237-4ab4-80de-b4d27a572dd1 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:21.244738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeea1f-daf3-4737-b1a3-1a398f0b3a03 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:21.259426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:21.260076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:21.260357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:21.260633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:21.261455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] RBAC: Adding query filter params (role.id=2bc8445e24e44f379e0a777e8b0c3d4c, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=6867f7729ddf465ca6d31df087c00881) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:21.261764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:21.263199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:21.269350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 544/1103] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:21 2022] GET /identity/v3/role_assignments?user.id=6867f7729ddf465ca6d31df087c00881&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=2bc8445e24e44f379e0a777e8b0c3d4c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:21.278527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:21.279242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:21.279529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:21.279805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:21.351996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:21.353384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:21.388986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:21.459144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 560/1104] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:24:21.462249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:21.508211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:21.566109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b62f9-0e55-42d6-9231-412cdc920152 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:21.600097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab2c88-bfc8-418b-9d50-fea048642a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:21.601500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2c88-bfc8-418b-9d50-fea048642a96 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:21.601787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2c88-bfc8-418b-9d50-fea048642a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:21.602114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2c88-bfc8-418b-9d50-fea048642a96 None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:21.603315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab2c88-bfc8-418b-9d50-fea048642a96 None admin] RBAC: Authorizing `identity:get_project(project_id=5b2509c6aa8649bc995492af3aec1bf7)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:21.604746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab2c88-bfc8-418b-9d50-fea048642a96 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:21.606449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 545/1105] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:21 2022] GET /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:21.612561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:21.720272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58718e5f-df88-4302-8d3d-aa5926e0c166 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:21.755325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:21.756002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:21.756287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:21.756562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:21.757963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=5b2509c6aa8649bc995492af3aec1bf7, user.id=d40ac2451116437c96de21851bc2e314) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:21.758278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:21.759798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b02960-25d7-4f8f-b2c7-e3ea25447930 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:21.762664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:21.766243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 561/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:21 2022] GET /identity/v3/role_assignments?user.id=d40ac2451116437c96de21851bc2e314&scope.project.id=5b2509c6aa8649bc995492af3aec1bf7&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:23.951425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a990f4a-1cdd-4c8a-b96f-5d0c36a7fa52 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:23.951955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a990f4a-1cdd-4c8a-b96f-5d0c36a7fa52 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:23.952050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a990f4a-1cdd-4c8a-b96f-5d0c36a7fa52 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:23.953334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 546/1107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:23.958411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:23.958816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:23.958969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:23.976925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:23.978092 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:24.041368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 562/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:24.066239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a990f4a-1cdd-4c8a-b96f-5d0c36a7fa52 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:24.164834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a990f4a-1cdd-4c8a-b96f-5d0c36a7fa52 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:24.174879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:24.197936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa59ff-4a29-4da0-8893-c4c298565b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:24.198714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa59ff-4a29-4da0-8893-c4c298565b8b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:24.198996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa59ff-4a29-4da0-8893-c4c298565b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:24.199298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa59ff-4a29-4da0-8893-c4c298565b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:24.200491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa59ff-4a29-4da0-8893-c4c298565b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:24.202100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa59ff-4a29-4da0-8893-c4c298565b8b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:24.203958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 547/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:24.209535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:24.308499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c4a7-338e-47a2-b6cd-de91611660d2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:24.335832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:24.341397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e4de3-d16f-4dd5-adbd-dabfe113a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:24.342061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e4de3-d16f-4dd5-adbd-dabfe113a94a None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:24.345142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e4de3-d16f-4dd5-adbd-dabfe113a94a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:24.345142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e4de3-d16f-4dd5-adbd-dabfe113a94a None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:24.345142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e4de3-d16f-4dd5-adbd-dabfe113a94a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:24.345142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e4de3-d16f-4dd5-adbd-dabfe113a94a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:24.459885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 563/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:24:24 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:26.690456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43009d-b63b-40b8-aa0b-68a145dd9218 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:26.690959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43009d-b63b-40b8-aa0b-68a145dd9218 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:26.690959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43009d-b63b-40b8-aa0b-68a145dd9218 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:26.692460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 548/1111] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:26.698162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:26.698552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:26.698730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:26.715708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:26.716887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:26.781524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 564/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:26.804404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43009d-b63b-40b8-aa0b-68a145dd9218 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:26.901884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43009d-b63b-40b8-aa0b-68a145dd9218 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:26.934163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:26.935079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:26.935392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:26.935672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] PATH_INFO: `/v3/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:26.937127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] RBAC: Authorizing `identity:get_role(role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:26.938480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:26.939867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 549/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:26 2022] GET /identity/v3/roles/825ed394374246a6a9348bca22ceafae => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:26.946062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:27.040696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5cc63-6818-49d7-99a2-522295bfc914 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:27.056725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:27.074223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:27.075079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:27.080041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:27.080041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] PATH_INFO: `/v3/users/06c31d693c12455c99a48d13a95071d1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:27.088863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] RBAC: Authorizing `identity:get_user(user_id=06c31d693c12455c99a48d13a95071d1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:27.090320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:27.091986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 565/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:26 2022] GET /identity/v3/users/06c31d693c12455c99a48d13a95071d1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:27.097685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:27.143499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:27.195491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa6d4f-c7ff-4e04-84ef-59078558d7b9 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:27.227897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:27.228479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:27.228766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:27.229047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:27.293917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:27.295381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:27.337877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:27.390035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 550/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:27.395868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:27.499788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad64a2-49a3-4566-80f7-1bc8fd4745c7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:27.532022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097756f3-3038-47e9-845e-d2feb185b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:27.532867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097756f3-3038-47e9-845e-d2feb185b31a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:27.533158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097756f3-3038-47e9-845e-d2feb185b31a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:27.533438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097756f3-3038-47e9-845e-d2feb185b31a None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:27.534612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097756f3-3038-47e9-845e-d2feb185b31a None admin] RBAC: Authorizing `identity:get_project(project_id=5b2509c6aa8649bc995492af3aec1bf7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:27.536078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097756f3-3038-47e9-845e-d2feb185b31a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:27.537753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 566/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:27 2022] GET /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:27.544339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:27.637644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf92a2-c15e-4246-bd6c-2a90fe39b127 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:27.671316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:27.672396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:27.672786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:27.673068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:27.673951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] RBAC: Adding query filter params (role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=5b2509c6aa8649bc995492af3aec1bf7, user.id=06c31d693c12455c99a48d13a95071d1) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:27.674273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:27.675722 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab35ab-cd99-4d3c-bcfc-fe2c2c36c790 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:27.681725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 551/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:27 2022] GET /identity/v3/role_assignments?user.id=06c31d693c12455c99a48d13a95071d1&scope.project.id=5b2509c6aa8649bc995492af3aec1bf7&role.id=825ed394374246a6a9348bca22ceafae => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:29.843116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ae720-2d12-40f8-b64b-e5862ab93cec None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:29.843686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ae720-2d12-40f8-b64b-e5862ab93cec None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:29.843686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ae720-2d12-40f8-b64b-e5862ab93cec None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:29.845049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 567/1118] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:29.850562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:29.851557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:29.851730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:29.868478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:29.869630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:29.872338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:29.933626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 552/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:29.955439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ae720-2d12-40f8-b64b-e5862ab93cec None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:30.003418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:30.059765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ae720-2d12-40f8-b64b-e5862ab93cec None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:30.092193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:30.093034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:30.093367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:30.093595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] PATH_INFO: `/v3/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:30.095061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] RBAC: Authorizing `identity:get_role(role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:30.096452 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:30.097811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 568/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:29 2022] GET /identity/v3/roles/825ed394374246a6a9348bca22ceafae => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:30.104479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:30.199073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad728ee-a1da-4dab-9533-1024f56194df None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:30.232423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:30.233298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:30.233986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:30.233986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] PATH_INFO: `/v3/users/06c31d693c12455c99a48d13a95071d1` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:30.235041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] RBAC: Authorizing `identity:get_user(user_id=06c31d693c12455c99a48d13a95071d1)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:30.236512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:30.238141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 553/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:30 2022] GET /identity/v3/users/06c31d693c12455c99a48d13a95071d1 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:30.243795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:30.339411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0b1d4-b350-4698-8061-3c2ca6b1d339 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:30.349712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:30.372839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5c547-0a7b-4a3c-8983-a7e3e6645d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:30.373753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5c547-0a7b-4a3c-8983-a7e3e6645d71 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:30.374048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5c547-0a7b-4a3c-8983-a7e3e6645d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:30.374326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5c547-0a7b-4a3c-8983-a7e3e6645d71 None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:30.375520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5c547-0a7b-4a3c-8983-a7e3e6645d71 None admin] RBAC: Authorizing `identity:get_project(project_id=5b2509c6aa8649bc995492af3aec1bf7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:30.376951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5c547-0a7b-4a3c-8983-a7e3e6645d71 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:30.378676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 569/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:30 2022] GET /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:30.384621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:30.395239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:30.484662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78aec-1fcf-4612-89b5-8f70e69c0623 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:30.518915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7b7e-2879-4616-91ac-9ad30edc8f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:30.519823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7b7e-2879-4616-91ac-9ad30edc8f3d None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:30.520107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7b7e-2879-4616-91ac-9ad30edc8f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:30.520382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7b7e-2879-4616-91ac-9ad30edc8f3d None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7/users/06c31d693c12455c99a48d13a95071d1/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:30.522556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc7b7e-2879-4616-91ac-9ad30edc8f3d None admin] RBAC: Authorizing `identity:create_grant(project_id=5b2509c6aa8649bc995492af3aec1bf7, user_id=06c31d693c12455c99a48d13a95071d1, role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:30.524016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc7b7e-2879-4616-91ac-9ad30edc8f3d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:30.618133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 554/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:24:30 2022] PUT /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7/users/06c31d693c12455c99a48d13a95071d1/roles/825ed394374246a6a9348bca22ceafae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:24:32.768590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0debfb9-adf5-4589-9c48-3a7184a74958 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:32.769096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0debfb9-adf5-4589-9c48-3a7184a74958 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:32.769211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0debfb9-adf5-4589-9c48-3a7184a74958 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:32.770524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 570/1124] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:32.775906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:32.776311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:32.776460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:32.793113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:32.794269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:32.852204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:32.857350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 555/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:32.881662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0debfb9-adf5-4589-9c48-3a7184a74958 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:32.981393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0debfb9-adf5-4589-9c48-3a7184a74958 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:33.013501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:33.014350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:33.014635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:33.014907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] PATH_INFO: `/v3/roles/825ed394374246a6a9348bca22ceafae` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:33.016396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] RBAC: Authorizing `identity:get_role(role_id=825ed394374246a6a9348bca22ceafae)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:33.017792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:33.019229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 571/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:32 2022] GET /identity/v3/roles/825ed394374246a6a9348bca22ceafae => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:33.025338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:33.119625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0d5c5-48e6-4568-aaac-a63f0309b456 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:33.151839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:33.152688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:33.152974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:33.153251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] PATH_INFO: `/v3/users/06c31d693c12455c99a48d13a95071d1` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:33.154418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=06c31d693c12455c99a48d13a95071d1)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:33.155982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:33.157472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 556/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:33 2022] GET /identity/v3/users/06c31d693c12455c99a48d13a95071d1 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:33.163054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:33.207707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:33.259117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bee99e-30ff-4615-9426-02961c33a395 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:33.292491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:33.293104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:33.293391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:33.293674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:33.357920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:33.359390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:33.402742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:33.453352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 572/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:33.459235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:33.521976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:33.554781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70a55-f52e-4346-b344-975bdd0ab5e0 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:33.587313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef449768-e94b-4fbf-bcdf-923172223c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:33.588147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef449768-e94b-4fbf-bcdf-923172223c3e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:33.588433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef449768-e94b-4fbf-bcdf-923172223c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:33.588710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef449768-e94b-4fbf-bcdf-923172223c3e None admin] PATH_INFO: `/v3/projects/5b2509c6aa8649bc995492af3aec1bf7` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:33.589877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef449768-e94b-4fbf-bcdf-923172223c3e None admin] RBAC: Authorizing `identity:get_project(project_id=5b2509c6aa8649bc995492af3aec1bf7)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:33.591315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef449768-e94b-4fbf-bcdf-923172223c3e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:33.592972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 557/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:33 2022] GET /identity/v3/projects/5b2509c6aa8649bc995492af3aec1bf7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:33.598851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:33.693631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcc65a-9021-419f-9ac5-89d5ff6f1c19 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:33.726351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:33.726987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:33.727302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:33.727578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:33.728393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] RBAC: Adding query filter params (role.id=825ed394374246a6a9348bca22ceafae, scope.project.id=5b2509c6aa8649bc995492af3aec1bf7, user.id=06c31d693c12455c99a48d13a95071d1) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:33.728702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:33.730117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763cf8-b7b8-4b50-9858-c67414a070b8 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:33.735823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 573/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:33 2022] GET /identity/v3/role_assignments?user.id=06c31d693c12455c99a48d13a95071d1&scope.project.id=5b2509c6aa8649bc995492af3aec1bf7&role.id=825ed394374246a6a9348bca22ceafae => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:24:35.933805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97412d-1829-4db8-ab6e-1b0b3e0ee2bc None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:35.934337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97412d-1829-4db8-ab6e-1b0b3e0ee2bc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:35.934337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97412d-1829-4db8-ab6e-1b0b3e0ee2bc None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:35.935971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 558/1131] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:35.941118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:35.941534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:35.941670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:35.958427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:35.959643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:35.962309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:36.024149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 574/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:36.047119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97412d-1829-4db8-ab6e-1b0b3e0ee2bc None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:36.153846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97412d-1829-4db8-ab6e-1b0b3e0ee2bc None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:36.186099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2985c49-4ec2-4b2f-b598-200bb1f93a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:36.186823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2985c49-4ec2-4b2f-b598-200bb1f93a2f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:36.187191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2985c49-4ec2-4b2f-b598-200bb1f93a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:36.187462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2985c49-4ec2-4b2f-b598-200bb1f93a2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:36.188633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2985c49-4ec2-4b2f-b598-200bb1f93a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:36.190066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2985c49-4ec2-4b2f-b598-200bb1f93a2f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:36.191709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 559/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:36.198170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:36.292909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65c5b-7bf0-41f6-b0dc-4be7a8a7cc6b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:36.325809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4192-6a2e-4dbd-9b2d-1893ab50e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:36.326458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4192-6a2e-4dbd-9b2d-1893ab50e0f3 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:36.326742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4192-6a2e-4dbd-9b2d-1893ab50e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:36.327017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4192-6a2e-4dbd-9b2d-1893ab50e0f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:36.327744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4192-6a2e-4dbd-9b2d-1893ab50e0f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:36.329180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4192-6a2e-4dbd-9b2d-1893ab50e0f3 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:36.338395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:36.412455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 575/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:24:36 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:38.623678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbf0de-0e83-4586-9be4-06d2a9991fe5 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:38.624178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbf0de-0e83-4586-9be4-06d2a9991fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:38.624178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbf0de-0e83-4586-9be4-06d2a9991fe5 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:38.625512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 560/1135] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:38.630609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:38.630974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:38.631196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:38.648888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:38.650058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:38.714120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 576/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:38.738234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbf0de-0e83-4586-9be4-06d2a9991fe5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:38.741134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:38.836508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbf0de-0e83-4586-9be4-06d2a9991fe5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:38.868407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cb513-3607-4b82-b29f-50afc3b4f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:38.869187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cb513-3607-4b82-b29f-50afc3b4f784 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:38.869469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cb513-3607-4b82-b29f-50afc3b4f784 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:38.869744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cb513-3607-4b82-b29f-50afc3b4f784 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:38.870898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cb513-3607-4b82-b29f-50afc3b4f784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:38.872350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cb513-3607-4b82-b29f-50afc3b4f784 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:38.873986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 561/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:38.879601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:38.976329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fafee-76fc-4c4f-8525-bdc308d13851 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:38.998218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:39.009629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac7d6-c492-4bef-bc82-3ebef13dc032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:39.010336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac7d6-c492-4bef-bc82-3ebef13dc032 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:39.010685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac7d6-c492-4bef-bc82-3ebef13dc032 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:39.010965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac7d6-c492-4bef-bc82-3ebef13dc032 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:39.011694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac7d6-c492-4bef-bc82-3ebef13dc032 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:39.013126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac7d6-c492-4bef-bc82-3ebef13dc032 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:39.092833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 577/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:24:38 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:41.313522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb9b4-f9ab-4ae6-ab16-fcbf9e49e8b6 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:41.314027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb9b4-f9ab-4ae6-ab16-fcbf9e49e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:41.314115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb9b4-f9ab-4ae6-ab16-fcbf9e49e8b6 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:41.315490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 562/1139] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:41.320716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:41.321141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:41.321279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:41.338769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:41.340257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:41.409008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 578/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:41.432225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fb9b4-f9ab-4ae6-ab16-fcbf9e49e8b6 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:41.499872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:41.531708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fb9b4-f9ab-4ae6-ab16-fcbf9e49e8b6 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:41.565885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:41.566671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:41.567012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:41.567273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:41.577739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:41.585906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:41.587056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:41.588012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 563/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:41.593185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:41.687627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dc6f8-fafe-40e2-b3dd-523291a4b532 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:41.696881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:41.720749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:41.721432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:41.721714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:41.721989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:41.722733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:41.723039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:41.724429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:41.732345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 579/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:41.738098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:41.835385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead76ee5-1cd0-4125-8ee7-2f420224fceb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:41.870850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:41.876605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:41.877480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:41.877761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:41.878057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] PATH_INFO: `/v3/users/76ec0d3712c541eb93c6447fc2dc2030` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:41.891703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] RBAC: Authorizing `identity:get_user(user_id=76ec0d3712c541eb93c6447fc2dc2030)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:41.893135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:41.894794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 564/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:41 2022] GET /identity/v3/users/76ec0d3712c541eb93c6447fc2dc2030 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:41.901197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:41.996947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae673d5-0377-4ac9-b370-6fb2a4b9d06b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:42.029023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:42.029657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:42.029939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:42.030215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:42.066864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:42.093929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:42.095417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:42.188699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 580/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:42.195307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:42.301625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6678f-9095-4c50-a471-4310d9550b0a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:42.335848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f3a7c-666a-4d78-b57c-a157640239cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:42.336728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3a7c-666a-4d78-b57c-a157640239cb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:42.337012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3a7c-666a-4d78-b57c-a157640239cb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:42.337289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3a7c-666a-4d78-b57c-a157640239cb None admin] PATH_INFO: `/v3/projects/90b8ab06e71746689d2b811f23d309f3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:42.338454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f3a7c-666a-4d78-b57c-a157640239cb None admin] RBAC: Authorizing `identity:get_project(project_id=90b8ab06e71746689d2b811f23d309f3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:42.339905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f3a7c-666a-4d78-b57c-a157640239cb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:42.341587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 565/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:42 2022] GET /identity/v3/projects/90b8ab06e71746689d2b811f23d309f3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:42.347702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:42.415216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:42.444936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4dcb6-8c1e-4178-b184-e8eac70c7d41 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:42.477826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:42.478470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:42.478756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:42.479040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:42.479893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=90b8ab06e71746689d2b811f23d309f3, user.id=76ec0d3712c541eb93c6447fc2dc2030) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:42.480207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:42.481723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642461f-8d79-4e85-ac5e-107dbdd96aa0 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:42.487009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 581/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:42 2022] GET /identity/v3/role_assignments?user.id=76ec0d3712c541eb93c6447fc2dc2030&scope.project.id=90b8ab06e71746689d2b811f23d309f3&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:44.651133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2edc1-fd56-433f-963f-552058731393 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:44.651657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2edc1-fd56-433f-963f-552058731393 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:44.651657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2edc1-fd56-433f-963f-552058731393 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:44.652959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 566/1147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:44.658161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249b22-6168-4804-8776-777849f18000 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:44.658587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249b22-6168-4804-8776-777849f18000 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:44.658720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249b22-6168-4804-8776-777849f18000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:44.675623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-19249b22-6168-4804-8776-777849f18000 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:44.676790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-19249b22-6168-4804-8776-777849f18000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:44.741976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 582/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:44.763395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2edc1-fd56-433f-963f-552058731393 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:44.818105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:44.860624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2edc1-fd56-433f-963f-552058731393 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:44.892305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:44.893084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:44.893370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:44.893647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:44.903426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:44.910923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:44.911872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:44.912736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 567/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:44.918466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249b22-6168-4804-8776-777849f18000 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:44.978187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:45.013088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249b22-6168-4804-8776-777849f18000 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:45.046930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:45.047613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:45.047898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:45.048174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:45.048916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:45.049223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:45.050596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:45.058579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 583/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:45.064419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:45.161059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e7dd-9d5b-4c04-ace3-44d660b49062 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:45.176926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:45.193941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:45.194881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:45.195190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:45.195470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] PATH_INFO: `/v3/users/76ec0d3712c541eb93c6447fc2dc2030` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:45.196664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] RBAC: Authorizing `identity:get_user(user_id=76ec0d3712c541eb93c6447fc2dc2030)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:45.198100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:45.199790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 568/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:45 2022] GET /identity/v3/users/76ec0d3712c541eb93c6447fc2dc2030 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:45.205511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:45.302516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb044b-6e20-4bf4-8279-26ae1703098a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:45.326605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:45.335430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9da68-3473-460e-9ee2-83624e31a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:45.336283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9da68-3473-460e-9ee2-83624e31a560 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:45.336561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9da68-3473-460e-9ee2-83624e31a560 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:45.336829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9da68-3473-460e-9ee2-83624e31a560 None admin] PATH_INFO: `/v3/projects/90b8ab06e71746689d2b811f23d309f3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:45.337992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9da68-3473-460e-9ee2-83624e31a560 None admin] RBAC: Authorizing `identity:get_project(project_id=90b8ab06e71746689d2b811f23d309f3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:45.339514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9da68-3473-460e-9ee2-83624e31a560 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:45.341181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 584/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:45 2022] GET /identity/v3/projects/90b8ab06e71746689d2b811f23d309f3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:45.347142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:45.443276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82401e4-4824-4ca5-a5cc-4fe9258e20ab None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:45.476239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514007f-7712-46ba-9370-8e0746455b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:45.477110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514007f-7712-46ba-9370-8e0746455b21 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:45.477398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514007f-7712-46ba-9370-8e0746455b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:45.477678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514007f-7712-46ba-9370-8e0746455b21 None admin] PATH_INFO: `/v3/projects/90b8ab06e71746689d2b811f23d309f3/users/76ec0d3712c541eb93c6447fc2dc2030/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:45.479643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514007f-7712-46ba-9370-8e0746455b21 None admin] RBAC: Authorizing `identity:create_grant(project_id=90b8ab06e71746689d2b811f23d309f3, user_id=76ec0d3712c541eb93c6447fc2dc2030, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:45.481064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514007f-7712-46ba-9370-8e0746455b21 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:45.576828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 569/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:24:45 2022] PUT /identity/v3/projects/90b8ab06e71746689d2b811f23d309f3/users/76ec0d3712c541eb93c6447fc2dc2030/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:24:47.727214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870205e6-89a8-4301-b80b-9d90aeca4f35 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:47.727737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870205e6-89a8-4301-b80b-9d90aeca4f35 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:47.727829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870205e6-89a8-4301-b80b-9d90aeca4f35 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:47.729157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 585/1154] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:47.734326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:47.734688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:47.734886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:47.751306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:47.752468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:47.791257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:47.815949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 570/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:47.839835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870205e6-89a8-4301-b80b-9d90aeca4f35 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:47.942697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870205e6-89a8-4301-b80b-9d90aeca4f35 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:47.974768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:47.975856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:47.976138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:47.976414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:47.986006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:24:47.994021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:47.994940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:24:47.995827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 586/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:24:48.001341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:48.095958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959290-da64-460e-bd3e-ca092ae8593a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:48.128812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:48.129463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:48.129742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:48.130017 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:48.130788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:48.131115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:48.133004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:48.140837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 571/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:48.146529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:48.200251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:48.254774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceded737-5138-4d74-9210-7223c3a1cf51 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:48.287259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:48.288124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:48.288408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:48.288683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] PATH_INFO: `/v3/users/76ec0d3712c541eb93c6447fc2dc2030` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:48.289857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] RBAC: Authorizing `identity:get_user(user_id=76ec0d3712c541eb93c6447fc2dc2030)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:48.291328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:48.292946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 587/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:24:48 2022] GET /identity/v3/users/76ec0d3712c541eb93c6447fc2dc2030 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:48.298749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:48.333344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:48.394888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2ebcd-22f4-4c4a-8e10-a276907a72fc None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:48.426897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:48.427564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:48.427848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:48.428126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:48.491734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:48.493153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:48.525151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:48.586778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 572/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:48.592532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:48.687686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0fa7b-0086-489c-9127-81a860fc0512 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:48.708844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:48.719524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff03f7-b3c4-4ee5-b21b-f2e9c162cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:48.720359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff03f7-b3c4-4ee5-b21b-f2e9c162cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:48.720638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff03f7-b3c4-4ee5-b21b-f2e9c162cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:48.720954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff03f7-b3c4-4ee5-b21b-f2e9c162cbc1 None admin] PATH_INFO: `/v3/projects/90b8ab06e71746689d2b811f23d309f3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:48.722106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff03f7-b3c4-4ee5-b21b-f2e9c162cbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=90b8ab06e71746689d2b811f23d309f3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:48.723577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff03f7-b3c4-4ee5-b21b-f2e9c162cbc1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:48.732565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 588/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:24:48 2022] GET /identity/v3/projects/90b8ab06e71746689d2b811f23d309f3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:48.733115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:48.826163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1aef1-7895-49d1-ba14-c0658539a045 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:48.857340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:48.857973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:48.858255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:48.858531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:48.859376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=90b8ab06e71746689d2b811f23d309f3, user.id=76ec0d3712c541eb93c6447fc2dc2030) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:48.859686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:48.861086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93122e-9f4f-46e1-af60-59e7dbb6317c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:48.863829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:48.867566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 573/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:24:48 2022] GET /identity/v3/role_assignments?user.id=76ec0d3712c541eb93c6447fc2dc2030&scope.project.id=90b8ab06e71746689d2b811f23d309f3&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:51.052536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a986-adde-4ae4-acf3-0e7018bf7f97 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:51.053098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a986-adde-4ae4-acf3-0e7018bf7f97 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:51.053098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8a986-adde-4ae4-acf3-0e7018bf7f97 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:51.054448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 589/1162] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:51.059723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:51.060132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:51.060276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:51.077054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:51.078217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:51.141768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 574/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:51.164666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8a986-adde-4ae4-acf3-0e7018bf7f97 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:51.288682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8a986-adde-4ae4-acf3-0e7018bf7f97 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:51.321638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:51.322210 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:51.322491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:51.322766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:51.377410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:51.387651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:51.389100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:51.483441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 590/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:24:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:24:51.489543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:51.599056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8beee-af28-49c8-bc8d-9dee278e9a85 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:51.632054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:51.638038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:51.639840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:51.640126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:51.640403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:51.650921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:51.652482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-d0f22509-c24d-4082-b1af-6f39cde7d6ed None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:24:51.668071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:24:51.669279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:24:51.670390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 575/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:24:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:24:51.675319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:51.764515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:51.773833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d8160-342e-412d-9059-5c7440315454 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:51.808582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:51.809252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:51.809530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:51.809817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:51.810563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:51.810853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:51.812266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c83f6-44a0-4a4d-aafc-d876b937d97e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:51.820413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 591/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 23 15:24:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:53.992269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f39d-e8b7-4118-b71b-33a58090e56e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:53.992807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f39d-e8b7-4118-b71b-33a58090e56e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:53.992807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f39d-e8b7-4118-b71b-33a58090e56e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:53.994192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 576/1167] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:53.999526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ac7c-1768-41bc-b6fb-2b3128811237 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:53.999925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ac7c-1768-41bc-b6fb-2b3128811237 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:54.000083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ac7c-1768-41bc-b6fb-2b3128811237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:54.016955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2545ac7c-1768-41bc-b6fb-2b3128811237 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:54.018132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2545ac7c-1768-41bc-b6fb-2b3128811237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:54.082603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 592/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:54.104851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f39d-e8b7-4118-b71b-33a58090e56e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:54.203255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f39d-e8b7-4118-b71b-33a58090e56e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:54.236239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829b47-5c26-491d-aabd-785c4506d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:54.236904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829b47-5c26-491d-aabd-785c4506d754 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:54.237183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829b47-5c26-491d-aabd-785c4506d754 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:54.237455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829b47-5c26-491d-aabd-785c4506d754 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:54.238194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829b47-5c26-491d-aabd-785c4506d754 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:54.239585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829b47-5c26-491d-aabd-785c4506d754 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:54.317115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 577/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Mon May 23 15:24:54 2022] POST /identity/v3/domains => generated 267 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:56.493689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37685-b750-4f6c-89ba-f8ed45bdb560 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:56.494219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37685-b750-4f6c-89ba-f8ed45bdb560 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:56.494219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba37685-b750-4f6c-89ba-f8ed45bdb560 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:56.495653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 593/1170] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:56.501096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:56.501520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:56.501663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:56.518111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:56.519318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:56.564054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:56.584697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 578/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:24:56.608839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba37685-b750-4f6c-89ba-f8ed45bdb560 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:56.712754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:56.733325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba37685-b750-4f6c-89ba-f8ed45bdb560 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:56.769458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4388b-2b29-4eb5-b5ad-7d7536d1f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:56.770363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4388b-2b29-4eb5-b5ad-7d7536d1f6dc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:56.770699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4388b-2b29-4eb5-b5ad-7d7536d1f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:56.770983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4388b-2b29-4eb5-b5ad-7d7536d1f6dc None admin] PATH_INFO: `/v3/domains/155fc4b0b3254ee199bca685d2599e20` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:56.782792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4388b-2b29-4eb5-b5ad-7d7536d1f6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=155fc4b0b3254ee199bca685d2599e20)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:56.784445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4388b-2b29-4eb5-b5ad-7d7536d1f6dc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:56.786142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 594/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 23 15:24:56 2022] GET /identity/v3/domains/155fc4b0b3254ee199bca685d2599e20 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:56.792149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:56.887173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52553c10-43c1-4921-a47d-bf77d4d8518e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:56.919461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2f6c-a906-4e85-a352-bdab93ad9bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:56.920107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2f6c-a906-4e85-a352-bdab93ad9bed None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:56.920392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2f6c-a906-4e85-a352-bdab93ad9bed None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:56.920671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2f6c-a906-4e85-a352-bdab93ad9bed None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:56.921370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2f6c-a906-4e85-a352-bdab93ad9bed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:56.922783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2f6c-a906-4e85-a352-bdab93ad9bed None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:57.002288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 579/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:24:56 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:59.229491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0c90-a261-4746-b59a-79207145eb6c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:59.230050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0c90-a261-4746-b59a-79207145eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:59.230442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0c90-a261-4746-b59a-79207145eb6c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:59.231852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 595/1174] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:59.237372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:59.237784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:59.237934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:59.254852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:59.256070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:59.282041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:59.321532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 580/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:24:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:24:59.346567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a0c90-a261-4746-b59a-79207145eb6c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:59.445720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a0c90-a261-4746-b59a-79207145eb6c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:59.478013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f358-ef27-4c35-b4db-79e21b360f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:59.478857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f358-ef27-4c35-b4db-79e21b360f05 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:59.479167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f358-ef27-4c35-b4db-79e21b360f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:59.479446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f358-ef27-4c35-b4db-79e21b360f05 None admin] PATH_INFO: `/v3/domains/155fc4b0b3254ee199bca685d2599e20` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:59.480668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f358-ef27-4c35-b4db-79e21b360f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=155fc4b0b3254ee199bca685d2599e20)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:59.482048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f358-ef27-4c35-b4db-79e21b360f05 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:59.483666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 596/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 23 15:24:59 2022] GET /identity/v3/domains/155fc4b0b3254ee199bca685d2599e20 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:59.489312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:59.585793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b4ae8-2b95-45c5-89ba-01c6e80bf5dd None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:59.618871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417cc9-1be3-4f3f-83d4-10f2ade0add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:59.619581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417cc9-1be3-4f3f-83d4-10f2ade0add6 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:59.619868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417cc9-1be3-4f3f-83d4-10f2ade0add6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:59.620147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417cc9-1be3-4f3f-83d4-10f2ade0add6 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:59.620860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417cc9-1be3-4f3f-83d4-10f2ade0add6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:59.622346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417cc9-1be3-4f3f-83d4-10f2ade0add6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:59.731468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 581/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:24:59 2022] POST /identity/v3/users => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:25:01.964733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ef46d-ec27-4f2c-abe8-5334c2d896ce None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:01.965279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ef46d-ec27-4f2c-abe8-5334c2d896ce None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:01.965435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ef46d-ec27-4f2c-abe8-5334c2d896ce None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:01.966737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 597/1178] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:25:01.972069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:01.972480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:01.972641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:01.989279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:25:01.990450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:25:02.003267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:02.057280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 582/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:25:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:25:02.082499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ef46d-ec27-4f2c-abe8-5334c2d896ce None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:02.107159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:02.191017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ef46d-ec27-4f2c-abe8-5334c2d896ce None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:02.223670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:02.224385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:02.224670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:02.224988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:02.235245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:25:02.243384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:25:02.244490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:25:02.245615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 598/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:25:02.250644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:02.345891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2a4a8-01e6-4f4a-bb85-3a1db5aefe7a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:02.387420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:02.388078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:02.388358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:02.388631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:02.389373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:25:02.389676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:02.391043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:02.399274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 583/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:02.405026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:02.474055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:02.503206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff694f-aa9c-492a-aa4f-fd6e9e5ce471 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:02.536065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:02.536934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:02.537222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:02.538123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] PATH_INFO: `/v3/users/ae01e62377dd434d974f0c2af5dff8ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:02.550815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] RBAC: Authorizing `identity:get_user(user_id=ae01e62377dd434d974f0c2af5dff8ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:02.552303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:02.553933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 599/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:25:02 2022] GET /identity/v3/users/ae01e62377dd434d974f0c2af5dff8ec => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:02.559764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:02.572727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:02.656482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b23e-4cac-413e-a31c-630827ee3e5d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:02.688073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:02.688714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:02.689002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:02.689282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:02.757064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:02.758504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:02.769387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:02.854013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 584/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:25:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:25:02.860055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:02.956447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133abd22-272c-403c-a6c0-76a241ac7d7a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:02.983951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:02.989570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72445fc8-3287-4fc4-b2f8-b2a11a140e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:02.990414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72445fc8-3287-4fc4-b2f8-b2a11a140e00 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:02.994045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72445fc8-3287-4fc4-b2f8-b2a11a140e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:02.994045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72445fc8-3287-4fc4-b2f8-b2a11a140e00 None admin] PATH_INFO: `/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:02.994045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72445fc8-3287-4fc4-b2f8-b2a11a140e00 None admin] RBAC: Authorizing `identity:get_project(project_id=fe4ff97993204be28a85e7efd8d1ccfe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:02.994283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72445fc8-3287-4fc4-b2f8-b2a11a140e00 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:02.995798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 600/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:25:02 2022] GET /identity/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:03.002041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:03.103651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a7bec-bfa7-4bc2-86f7-cced0fb5bf0d None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:03.113837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:03.136915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:03.137624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:03.137913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:03.138188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:03.139015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=fe4ff97993204be28a85e7efd8d1ccfe, user.id=ae01e62377dd434d974f0c2af5dff8ec) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:25:03.139357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:03.140779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bad34-1b01-41b4-834a-d31fe4b5bc3d None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:03.146517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 585/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:25:03 2022] GET /identity/v3/role_assignments?user.id=ae01e62377dd434d974f0c2af5dff8ec&scope.project.id=fe4ff97993204be28a85e7efd8d1ccfe&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:05.284334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164867e1-eb06-45ca-b6b7-82d378a231f1 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:05.284823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164867e1-eb06-45ca-b6b7-82d378a231f1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:05.284938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164867e1-eb06-45ca-b6b7-82d378a231f1 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:05.286261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 601/1186] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:25:05.291378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:05.291791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:05.291946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:05.308769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:25:05.309939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:25:05.374336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 586/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:25:05.397101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164867e1-eb06-45ca-b6b7-82d378a231f1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:05.495311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164867e1-eb06-45ca-b6b7-82d378a231f1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:05.527777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:05.528554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:05.528839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:05.529117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:05.538855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:25:05.546402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:25:05.547464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:25:05.548337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 602/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:25:05.553992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:05.649450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b88a-6b0d-4ed3-985e-8b148fd71baf None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:05.651771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:05.682815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:05.683504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:05.683787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:05.684060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:05.684796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:25:05.685100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:05.686904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:05.694618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 587/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:05.700516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:05.757733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:05.797699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcc0e0-1354-4dd7-b10b-2dcc6b72f5ba None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:05.829835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:05.830683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:05.830962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:05.831258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] PATH_INFO: `/v3/users/ae01e62377dd434d974f0c2af5dff8ec` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:05.832423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] RBAC: Authorizing `identity:get_user(user_id=ae01e62377dd434d974f0c2af5dff8ec)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:05.833854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:05.835508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 603/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:25:05 2022] GET /identity/v3/users/ae01e62377dd434d974f0c2af5dff8ec => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:05.841284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:05.938314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ada58-ad87-4ba4-9009-886111f381db None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:05.971014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c5dde-b2b4-4e79-b34b-5d2a99b61205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:05.971892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c5dde-b2b4-4e79-b34b-5d2a99b61205 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:05.972175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c5dde-b2b4-4e79-b34b-5d2a99b61205 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:05.972453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c5dde-b2b4-4e79-b34b-5d2a99b61205 None admin] PATH_INFO: `/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:05.973614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c5dde-b2b4-4e79-b34b-5d2a99b61205 None admin] RBAC: Authorizing `identity:get_project(project_id=fe4ff97993204be28a85e7efd8d1ccfe)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:05.975876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c5dde-b2b4-4e79-b34b-5d2a99b61205 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:05.977570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 588/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:25:05 2022] GET /identity/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:05.983540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:06.079123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb8c3-904e-44b4-bfc7-7698e8c7c55e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:06.104074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:06.112496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd7354-463c-4f37-9630-708ffa517c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:06.119226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7354-463c-4f37-9630-708ffa517c2a None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:06.119226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7354-463c-4f37-9630-708ffa517c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:06.119226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7354-463c-4f37-9630-708ffa517c2a None admin] PATH_INFO: `/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe/users/ae01e62377dd434d974f0c2af5dff8ec/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:06.119226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd7354-463c-4f37-9630-708ffa517c2a None admin] RBAC: Authorizing `identity:create_grant(project_id=fe4ff97993204be28a85e7efd8d1ccfe, user_id=ae01e62377dd434d974f0c2af5dff8ec, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:06.119226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd7354-463c-4f37-9630-708ffa517c2a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:06.213464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 604/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:25:05 2022] PUT /identity/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe/users/ae01e62377dd434d974f0c2af5dff8ec/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:25:08.392983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995cf2-3907-4357-8b61-fc643730ef97 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:08.393544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995cf2-3907-4357-8b61-fc643730ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:08.393544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995cf2-3907-4357-8b61-fc643730ef97 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:08.394932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 589/1193] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:25:08.400161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:08.400543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:08.400723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:08.417213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:25:08.418401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:25:08.492900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 605/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:25:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:25:08.518881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22995cf2-3907-4357-8b61-fc643730ef97 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:08.553747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:08.618004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22995cf2-3907-4357-8b61-fc643730ef97 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:08.649840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:08.650618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:08.650904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:08.651207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:08.661044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:25:08.669159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:25:08.670291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:25:08.671396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 590/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:25:08.676292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:08.771970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfffeb-067d-4fb3-bcdf-d94c6bac430a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:08.788340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:08.805855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:08.806519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:08.806809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:08.807110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:08.807867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:25:08.808178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:08.809555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:08.817592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 606/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:08.823310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:08.913700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:08.919973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a83f-5a36-4283-b120-e1168b17a7a5 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:08.952720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:08.953585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:08.953878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:08.954158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] PATH_INFO: `/v3/users/ae01e62377dd434d974f0c2af5dff8ec` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:08.955358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] RBAC: Authorizing `identity:get_user(user_id=ae01e62377dd434d974f0c2af5dff8ec)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:08.956784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:08.958420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 591/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 23 15:25:08 2022] GET /identity/v3/users/ae01e62377dd434d974f0c2af5dff8ec => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:08.964676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:09.062132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b9b4-2de8-468d-b5fd-203c463c4d5e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:09.095140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:09.095780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:09.096065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:09.096336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:09.140546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:09.161331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:09.163349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:09.260097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 607/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:25:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:25:09.265928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:09.361382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983dfa7-a17a-432e-8eb8-cc4dc4d3eee3 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:09.393601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a7edb-6fa8-461d-a149-7176a956221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:09.394449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a7edb-6fa8-461d-a149-7176a956221f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:09.394734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a7edb-6fa8-461d-a149-7176a956221f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:09.395012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a7edb-6fa8-461d-a149-7176a956221f None admin] PATH_INFO: `/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:09.396494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a7edb-6fa8-461d-a149-7176a956221f None admin] RBAC: Authorizing `identity:get_project(project_id=fe4ff97993204be28a85e7efd8d1ccfe)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:09.398736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a7edb-6fa8-461d-a149-7176a956221f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:09.400458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 592/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 23 15:25:09 2022] GET /identity/v3/projects/fe4ff97993204be28a85e7efd8d1ccfe => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:09.406495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:25:09.482018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:09.502384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887083ec-e7ae-46e8-8aa6-46b86c7c6435 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:25:09.536075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:25:09.536724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:25:09.537011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:25:09.537319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:25:09.538146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=fe4ff97993204be28a85e7efd8d1ccfe, user.id=ae01e62377dd434d974f0c2af5dff8ec) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:25:09.538459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:25:09.539935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d7f9-1a31-4d2c-b6a2-865b0b32fed5 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:25:09.545653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 608/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:25:09 2022] GET /identity/v3/role_assignments?user.id=ae01e62377dd434d974f0c2af5dff8ec&scope.project.id=fe4ff97993204be28a85e7efd8d1ccfe&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:25:19.389599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=85 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:25:19.543134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=29 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:33.717897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b834-c5a9-4e91-ac0d-3b831af880d9 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:33.718470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b834-c5a9-4e91-ac0d-3b831af880d9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:33.718470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b834-c5a9-4e91-ac0d-3b831af880d9 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:33.719823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 593/1201] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:33.725273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:33.725768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:33.725864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:33.743248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:33.744436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:33.811715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 609/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:33.837127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b834-c5a9-4e91-ac0d-3b831af880d9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:33.946573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b834-c5a9-4e91-ac0d-3b831af880d9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:33.986814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:33.986814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:33.986814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:33.986814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:33.994365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:33.995832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:34.013334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:34.014538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:34.015804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:34.015804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:34.015804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:34.015804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:34.015804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 594/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:34.021069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:34.121438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8f80-6dc7-4bca-b72c-0d95ac24bb3d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:34.152561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:34.158223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:34.158889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:34.159202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:34.159482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:34.160206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:34.160516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:34.161920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a3953-086e-41ec-a0a8-e620849dfcdb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:34.172921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 610/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:34.178728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:34.234421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:34.280223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a5169-6d5a-4438-b0af-d535012824ee None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:34.313841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba72ba1-8642-4f58-8f95-db4fd1e10920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:34.314510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba72ba1-8642-4f58-8f95-db4fd1e10920 None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:34.314796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba72ba1-8642-4f58-8f95-db4fd1e10920 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:34.315074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba72ba1-8642-4f58-8f95-db4fd1e10920 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:34.315813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba72ba1-8642-4f58-8f95-db4fd1e10920 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:34.317296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba72ba1-8642-4f58-8f95-db4fd1e10920 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:34.387496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 595/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 23 15:26:34 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:26:36.687578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a8d78-0086-45c7-a4db-2d126bd567d9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:36.688093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a8d78-0086-45c7-a4db-2d126bd567d9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:36.688093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a8d78-0086-45c7-a4db-2d126bd567d9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:36.689478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 611/1206] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:36.694904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:36.695367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:36.695516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:36.712624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:36.713869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:36.780579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 596/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:36.804337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a8d78-0086-45c7-a4db-2d126bd567d9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:36.906080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a8d78-0086-45c7-a4db-2d126bd567d9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:36.940309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:36.941019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:36.941301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:36.941577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:36.952048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:26:36.960274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:36.967591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:36.968660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 612/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:26:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:36.969536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:37.006663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:37.063320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be1fd2-d333-46b4-8b24-9d088f4a456b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:37.096864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:37.097524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:37.097806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:37.098084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:37.098933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:37.099268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:37.100619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:37.109155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 597/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:26:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:37.114560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:37.174767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:37.223445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c86ef-4cfd-49dd-ac41-27be47403c0a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:37.258277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:37.259067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:37.259382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:37.259658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:37.271013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:37.275314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:37.290185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:37.291278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:37.292375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:37.292375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:37.292375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:37.292375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:37.292375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 613/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:37.298634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:37.395249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:37.398427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b791a8-ca17-44ea-9c43-34b54bdfb411 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:37.432604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:37.433264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:37.433550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:37.433830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:37.434567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:37.434863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:37.436250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:37.447233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 598/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:37.453044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:37.559968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64734d-6b84-4210-a3cb-70cb4dabe439 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:37.561551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:37.593503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:37.594303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:37.601350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:37.601350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:37.602838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:37.604317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:26:37.619173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:37.620778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:37.621909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 614/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:26:37.626262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:37.733426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec646ee-4a02-4d98-9bfa-b45c7dea8cab None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:37.768067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:37.768742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:37.769024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:37.769300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:37.770132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:37.770492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:37.771934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:37.789814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 599/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 23 15:26:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:37.795760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:37.895289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932ab8e-e7b9-4b01-b9bf-ddff1d187010 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:37.929926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:37.930563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:37.930844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:37.931189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:37.961205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:37.998238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:37.999774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:38.100646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 615/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:26:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:26:38.106937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:38.125533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:38.206473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca600f-88eb-4ec1-aeea-3d07ee00b37e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:38.242414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:38.243253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:38.250907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:38.250907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:38.253762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:38.255839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:38.273371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:38.274453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:38.275712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:38.275712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:38.275712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:38.275712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:38.275712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 600/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:38.280422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:38.341916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:38.380454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84d96-b8e7-4092-9b46-d64c01c7cc77 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:38.415198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:38.415852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:38.416140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:38.416405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:38.417146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:38.417451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:38.418832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:38.430758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 616/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:38.436768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:38.508568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:38.541012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952e14-e27f-4cdd-836c-a78450c8a3aa None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:38.573229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:38.574011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:38.574298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:38.574576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:38.581956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:38.584006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:26:38.598087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:38.599731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:38.600975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 601/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:38.605945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:38.705384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f502-bbef-4baf-bb41-21122e5b0667 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:38.728785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:38.740701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:38.741516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:38.741814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:38.742092 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:38.742875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:38.743213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:38.744799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24f00-0da5-40d7-8695-3500e5ab314c None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:38.756160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 617/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:38.762390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:38.863286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06196bb7-e9d4-4daa-ba1c-e2a698da0074 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:38.890797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:38.898299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:38.898946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:38.899268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:38.899542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:38.900363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=99e4d094e08a4f1d92aed40961789f03) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:38.900672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:38.902082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8457f-ac08-434c-8ee8-9b95d95216b5 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:38.907759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 602/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:26:38 2022] GET /identity/v3/role_assignments?user.id=99e4d094e08a4f1d92aed40961789f03&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:41.050229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507f44c-9737-4e35-87b9-63a209026fe0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.050818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507f44c-9737-4e35-87b9-63a209026fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.050818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507f44c-9737-4e35-87b9-63a209026fe0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.052202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 618/1220] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:41.057272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.057698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.057833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.074674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:41.075873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:41.143732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 603/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:41.167242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507f44c-9737-4e35-87b9-63a209026fe0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:41.277363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507f44c-9737-4e35-87b9-63a209026fe0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:41.311202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:41.311929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.312210 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.312483 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.322877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:26:41.330617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:41.335914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:41.336795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 619/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:41.338507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:41.435971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aeee1-7c4c-45f8-88cf-dc415a6cb550 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:41.458489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:41.468588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:41.469249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.469528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.469801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.470535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:41.470838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:41.472232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:41.480756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 604/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:41.486596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:41.534714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:41.591171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc5779-dcff-4bf5-8380-e6ae4bc896aa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:41.623957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:41.624743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.625027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.625304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.636844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:41.638288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:41.655429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:41.656529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:41.657693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:41.657693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:41.657693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:41.657693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:41.657693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 620/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:41.662900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:41.763441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab564d-9951-45d5-90e5-b8848433b4ba None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:41.797213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:41.797903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.798189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.798470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.799244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:41.799555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:41.802350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:41.813736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 605/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:41.820071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:41.919764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:41.924676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a4ad0-5f73-48f4-b0c9-aaf068844e10 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:41.960525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:41.961323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:41.961602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:41.961877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:41.969334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:41.970774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:26:41.986094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:41.992150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:41.993271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 621/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:41.994000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:42.042627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:42.098194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48364-0326-45bd-88dc-e50e094306bf None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:42.131747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:42.132416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:42.132703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:42.132985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:42.133819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:42.134134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:42.135689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:42.153967 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 606/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 23 15:26:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:42.159774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:42.260860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d576a-213a-4cbb-abea-040f4e19e0bb None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:42.296004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:42.296794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:42.297072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:42.297346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:42.307377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:42.308819 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:42.326350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:42.327477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:42.328581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:42.328581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:42.328581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:42.328581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:42.328581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 622/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:42.333892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:42.433500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01286fae-3a35-4ce6-a103-2fc36d6518c6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:42.435873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:42.466835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:42.467523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:42.467810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:42.468089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:42.468816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:42.469125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:42.470483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:42.482426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 607/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:42.488469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:42.497046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:42.586404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b228-b69e-4547-9fb5-85d815cba5a7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:42.619630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:42.620424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:42.620709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:42.620987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:42.627608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:42.629059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:26:42.642977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:42.644020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:42.645282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 623/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:42.650634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:42.749124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d91fe-08a3-4ad8-8778-21d0a7048f37 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:42.781981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:42.782642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:42.782928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:42.783248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:42.784031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:42.784339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:42.785758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3f05-d438-4e3c-bfd9-5ed4dcfd09c3 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:42.798286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 608/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:42.804769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:42.870429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:42.904824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168bf5-6ccd-4c8e-957c-b29425b39b0f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:42.938239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72bb3-a29b-48ed-896f-64fcb9697ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:42.939142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72bb3-a29b-48ed-896f-64fcb9697ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:42.939430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72bb3-a29b-48ed-896f-64fcb9697ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:42.939707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72bb3-a29b-48ed-896f-64fcb9697ed4 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/99e4d094e08a4f1d92aed40961789f03/roles/afedb8ba64684cd496d9be9fe70ae8dd` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:42.954480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72bb3-a29b-48ed-896f-64fcb9697ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=99e4d094e08a4f1d92aed40961789f03, role_id=afedb8ba64684cd496d9be9fe70ae8dd)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:42.955968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72bb3-a29b-48ed-896f-64fcb9697ed4 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:43.046567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 624/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:26:42 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/99e4d094e08a4f1d92aed40961789f03/roles/afedb8ba64684cd496d9be9fe70ae8dd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:26:45.214991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d89e2-8462-48c1-9fd0-93fc384b55f4 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:45.215719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d89e2-8462-48c1-9fd0-93fc384b55f4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:45.215719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d89e2-8462-48c1-9fd0-93fc384b55f4 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:45.216977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 609/1233] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:45.222160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:45.222613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:45.222707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:45.242382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:45.244208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:45.313251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 625/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:45.338196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d89e2-8462-48c1-9fd0-93fc384b55f4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:45.363478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:45.438310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d89e2-8462-48c1-9fd0-93fc384b55f4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:45.470792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:45.471622 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:45.477448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:45.477448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:45.483197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:26:45.490958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:45.492150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:45.493128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 610/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 23 15:26:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:45.498116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:45.543774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:45.595879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b2748-4d4b-4342-85b9-5643425fd677 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:45.631425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:45.632100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:45.632386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:45.632667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:45.633422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] RBAC: Adding query filter params (name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:45.633732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:45.635149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:45.643889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 626/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 23 15:26:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:45.649654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:45.735284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:45.752683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1582-432b-4e81-80da-8b5401038279 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:45.785297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200de23-39c4-4c72-b122-41350429781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:45.786663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200de23-39c4-4c72-b122-41350429781b None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:45.786948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200de23-39c4-4c72-b122-41350429781b None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:45.787270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200de23-39c4-4c72-b122-41350429781b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:45.799862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200de23-39c4-4c72-b122-41350429781b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:45.801307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200de23-39c4-4c72-b122-41350429781b None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7200de23-39c4-4c72-b122-41350429781b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:45.819195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:45.820269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:45.821155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:45.821155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:45.821155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:45.821155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:45.821155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 611/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:45.826557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:45.935404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a625d-ae2e-491b-9ed4-1706bc1f0912 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:45.945465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:45.971699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:45.972563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:45.972969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:45.973355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:45.974215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:45.974682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:45.976380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:45.993184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 627/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:45.999261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200de23-39c4-4c72-b122-41350429781b None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:46.108033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200de23-39c4-4c72-b122-41350429781b None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:46.147247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:46.148091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:46.148361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:46.148697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:46.151884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:46.157118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:46.158616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:26:46.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:46.180570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:46.181953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 612/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:26:46.186386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:46.293546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de762-381e-4e14-b796-276d4ba383ba None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:46.328611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:46.329289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:46.329574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:46.329852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:46.330698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:46.331017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:46.336839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:46.351203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 628/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 23 15:26:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:46.357342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:46.460773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7f7e-34f5-4a7c-be06-cba1df4cb635 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:46.497969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:46.498624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:46.498908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:46.499217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:46.566251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:46.572615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:46.574079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:46.678460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 613/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:26:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:26:46.684749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:46.713274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:46.786950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f065b6-1d4b-4a6f-ba73-890035217fcf None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:46.822536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:46.823300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:46.823590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:46.823869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:46.835761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:46.837262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:46.856827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:46.858017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:46.859158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:46.859158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:46.859158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:46.859158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:46.859158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 629/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:26:46.864644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:46.960210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:46.965957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd167-ef67-4af2-9c57-6985803272f7 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:47.000773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:47.001455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:47.001716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:47.001993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:47.002847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:47.003190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:47.004587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:47.016105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 614/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:47.022003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:47.104196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:47.125989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f05bd3-a234-48bb-9109-fe86b95c5028 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:47.161127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:47.161924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:47.162212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:47.162556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:47.169362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:47.170843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:26:47.191530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:47.193349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:47.194453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 630/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:47.195396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:47.300300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa7e8c-f714-4839-9e2e-4a6aaef65f4c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:47.335278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:47.335942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:47.336223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:47.336497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:47.337312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:47.337619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:47.339035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30412-077e-4d98-a702-b336500bc071 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:47.351433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 615/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:47.364609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:47.465017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815d32-be79-46fc-8e4a-25077e65ecd6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:47.499782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:47.500442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:47.500739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:47.501009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:47.501853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] RBAC: Adding query filter params (role.id=afedb8ba64684cd496d9be9fe70ae8dd, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=99e4d094e08a4f1d92aed40961789f03) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:47.502169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:47.503676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b131063-12b1-4b7c-9cea-89c8e73023bf None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:47.511217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 631/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:26:47 2022] GET /identity/v3/role_assignments?user.id=99e4d094e08a4f1d92aed40961789f03&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=afedb8ba64684cd496d9be9fe70ae8dd => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:49.839285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f24a3-9537-47c8-bb2d-8b743513c854 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:49.839820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f24a3-9537-47c8-bb2d-8b743513c854 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:49.839820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f24a3-9537-47c8-bb2d-8b743513c854 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:49.841224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 616/1247] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:49.846698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:49.847120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:49.847293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:49.852552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:49.864659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:49.865850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:49.932314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 632/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:49.956604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f24a3-9537-47c8-bb2d-8b743513c854 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:49.977049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:50.063471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f24a3-9537-47c8-bb2d-8b743513c854 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:50.097907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:50.099187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:50.099473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:50.099747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:50.110396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:26:50.118713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:50.119817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:50.120683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 617/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:50.126018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:50.228644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f6916-9854-4fd6-8fb0-7c01450390f4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:50.260449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:50.265694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:50.266640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:50.266640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:50.266919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:50.267794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:50.268099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:50.269506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:50.279071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 633/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:50.285066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:50.366472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:50.389497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be680d-f729-4214-b276-f3498c25fdb4 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:50.423494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:50.424292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:50.424574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:50.424847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:50.437778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:50.439415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:50.457604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:50.458837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:50.459984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:50.459984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:50.459984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:50.459984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:50.459984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 618/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:50.464726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:50.568066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950a08b-95e2-44bd-ad5e-bce1411cf4b9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:50.603298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:50.603963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:50.604249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:50.604525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:50.605313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:50.605622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:50.606993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:50.622699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 634/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:50.628159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:50.737190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd45ab-9263-4d39-ade9-8f400fac111a None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:50.765027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:50.774565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:50.775937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:50.776821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:50.776946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:50.786899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:50.788361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:26:50.803254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:50.804481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:50.805814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 619/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:50.811160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:50.868688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:50.912065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24e882-7a51-4d68-9962-1789632e2f0b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:50.951356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:50.952035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:50.952315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:50.952653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:50.953497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:50.953806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:50.955584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:50.974628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 635/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 23 15:26:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:50.980839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:51.088704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57322cc1-21f8-4973-a088-be74d9d9b847 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:51.122502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:51.123242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:51.123510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:51.123782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:51.178637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:51.190401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:51.191958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:51.300920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 620/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:26:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:26:51.308394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:51.406393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414e42c-fbaa-40a4-9ddd-450cbe1ce8dc None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:51.420286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:51.444749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:51.444749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:51.444749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:51.444749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:51.451811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:51.453251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:51.470007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:51.471065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:51.472202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:51.472202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:51.472202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:51.472202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:51.472202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 636/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:51.477707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:51.564053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:51.576140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a18c-d6fa-453e-be74-2264912d8feb None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:51.609130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:51.609795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:51.610080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:51.610358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:51.611305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:51.611815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:51.613779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:51.624755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 621/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:51.631076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:51.731724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215500cc-2a81-41e5-b5a2-12674c3ba02f None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:51.766878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:51.767731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:51.768015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:51.768291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:51.779505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:51.781044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:26:51.795460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:51.798676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:51.799705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 637/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:51.803364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:51.907305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34326eac-e1a8-4780-a54e-19f060a9f6ca None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:51.943268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:51.943973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:51.944329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:51.944507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:51.945308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:51.945617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:51.947056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb69cd5-2edc-4a82-8a49-87d7846827ab None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:51.968378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 622/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:51.975479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:52.003760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:52.085434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce397e-afbf-4376-9ed6-7f6a00945678 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:52.120257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:52.120936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:52.121241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:52.121517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:52.122351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=99e4d094e08a4f1d92aed40961789f03) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:52.122712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:52.124177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a76590-5741-4f6a-a775-57b16ab35f68 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:52.130329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 638/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:26:51 2022] GET /identity/v3/role_assignments?user.id=99e4d094e08a4f1d92aed40961789f03&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=cc12091eec434ea294a879c1b207931e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:54.338717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e54b5-242f-4cd8-8833-b0e6d6cf66f3 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:54.339427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e54b5-242f-4cd8-8833-b0e6d6cf66f3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:54.339427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e54b5-242f-4cd8-8833-b0e6d6cf66f3 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:54.340710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 623/1261] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:54.346096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:54.346504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:54.346736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:54.364598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:54.365797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:54.450484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 639/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:54.473211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e54b5-242f-4cd8-8833-b0e6d6cf66f3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:54.485104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:54.582386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e54b5-242f-4cd8-8833-b0e6d6cf66f3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:54.625777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:54.626589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:54.626876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:54.627182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:54.639087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:26:54.649948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:54.651314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:54.652292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 624/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:54.658206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:54.682472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:54.777883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3d04e-4b77-4474-a49d-0a72d18d7f21 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:54.825321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:54.826011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:54.832669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:54.833002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:54.840958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:54.840958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:54.840958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:54.844893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 640/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:54.852865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:54.931943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:54.969745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce30d88-babd-40e9-9465-3ac7c9ca106e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:55.006274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:55.007076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:55.007394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:55.007677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:55.021000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:55.022464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:55.042643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:55.049456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:55.050588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:55.050588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:55.050588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:55.050588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:55.050588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 625/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:55.050945 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:55.144406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:55.167849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14daedd-5c19-4a98-86a9-4d7db6352a88 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:55.206492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:55.207186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:55.207480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:55.208298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:55.209037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:55.209349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:55.210731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:55.222562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 641/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:55.231813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:55.337457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6563b-8272-48f6-8dea-631f3c612820 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:55.360423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:55.374710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:55.375548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:55.375860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:55.376193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:55.384329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:55.385841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:26:55.401048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:55.402817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:55.405058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 626/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:55.408243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:55.518740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5485c-6bc8-40b7-9d4b-3e5967b1d397 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:55.553524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:55.554188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:55.554471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:55.554745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:55.555620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:55.555926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:55.557363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:55.566654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:55.575454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 642/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 23 15:26:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:55.581291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:55.695845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09938-ebc5-4adb-b089-e3832a8cb97f None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:55.743471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:55.744270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:55.744555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:55.744927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:55.756388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:55.757876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:55.775454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:55.777126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:55.778474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:55.778474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:55.778474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:55.778474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:55.778474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 627/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:26:55.782662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:55.885609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458c00-ea1d-4730-85ec-f20b1c6cbb54 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:55.920612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:55.921279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:55.921557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:55.921828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:55.922554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:55.922863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:55.924264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:55.936156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 643/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:55.941858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:55.975899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:56.056892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53138fbf-d1d4-4a96-8e1e-41caab378f83 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:56.093574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:56.094363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:56.094643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:56.094914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:56.102271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:56.104089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:26:56.118686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:56.124106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:26:56.125218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 628/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:56.127138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:56.192515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:56.235681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8fd3e-64a8-4649-b51c-eea7e46c9592 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:56.270962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:56.271803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:56.272085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:56.272365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:56.273161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:56.273468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:56.274909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842b0b8-56de-4f63-b4aa-07d9f85b628f None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:56.288121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 644/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:56.294753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:56.393364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:56.402365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf59457-4aa2-4d64-8c9f-dea6846811f3 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:56.437155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0819-b904-490b-8cad-002f2cc70649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:56.438047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0819-b904-490b-8cad-002f2cc70649 None admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:56.438335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0819-b904-490b-8cad-002f2cc70649 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:56.438616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0819-b904-490b-8cad-002f2cc70649 None admin] PATH_INFO: `/v3/projects/7fd46ffdca084231b63751f121b988fc/users/99e4d094e08a4f1d92aed40961789f03/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:56.440617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e0819-b904-490b-8cad-002f2cc70649 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd46ffdca084231b63751f121b988fc, user_id=99e4d094e08a4f1d92aed40961789f03, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:56.442087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e0819-b904-490b-8cad-002f2cc70649 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:56.669538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 629/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 23 15:26:56 2022] PUT /identity/v3/projects/7fd46ffdca084231b63751f121b988fc/users/99e4d094e08a4f1d92aed40961789f03/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:26:58.867152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08874ac-809e-4b99-9666-4492bab7b6b2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:58.867709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08874ac-809e-4b99-9666-4492bab7b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:58.867709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08874ac-809e-4b99-9666-4492bab7b6b2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:58.869101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 645/1274] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:58.874489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:58.874921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:58.875054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:58.891598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:58.892782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:58.960491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 630/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:26:58.984217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08874ac-809e-4b99-9666-4492bab7b6b2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:59.087688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08874ac-809e-4b99-9666-4492bab7b6b2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:59.106843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:59.123857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:59.124673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:59.124963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:59.125247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:59.136430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:26:59.144038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:59.146161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:59.147032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 646/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 23 15:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:59.152086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:59.233202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:59.251510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0128df-7c7d-4f8b-8503-85c99bcfaffd None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:59.285105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:59.285809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:59.286615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:59.286895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:59.287677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:59.287987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:59.289357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:59.297489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 631/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 23 15:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:59.303334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:59.407375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a46c-8717-40bb-a4bc-6dced29ae94b None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:59.447704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:59.448527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:59.448808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:59.449088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:59.459974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:59.461434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:26:59.479184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:59.480950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:59.482094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:26:59.482094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:26:59.482094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:26:59.482094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:59.482094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 647/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:59.486185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:59.584028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae53c7-f4eb-4977-99d3-060507bd88c6 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:59.620210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:59.620872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:59.621146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:59.621422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:59.622143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:59.622562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:59.624172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:59.636283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 632/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:59.642217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:59.674222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:59.745925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3900e5-cc05-49bb-bb41-a1d00150789e None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:59.780558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:59.781362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:59.781643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:59.781911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:59.789994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:59.791616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:26:59.808603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:26:59.814292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:26:59.815261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 648/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:26:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:26:59.820328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:59.824723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:59.919598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537dc66-a1a9-44c9-8795-588274f471ad None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:59.953215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:59.953813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:59.954095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:59.954375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:59.955232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:26:59.955539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:59.956941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:59.974531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 633/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 23 15:26:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:59.981467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:00.072540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:00.081824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78096f23-46cd-47c9-ade3-8811324b799a None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:00.117123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:00.117775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:00.118058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:00.118335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:00.194992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:00.196487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:00.290254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:00.308732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 649/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 23 15:26:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:27:00.315391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:00.382479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:00.421111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc947caf-563b-474a-99f9-61a25759d86e None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:00.459568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:00.460380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:00.460668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:00.460947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:00.471760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:00.473219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:27:00.492364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:27:00.493551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:27:00.494534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:27:00.494534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:27:00.494534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:27:00.494534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:27:00.494534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 634/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:27:00.499388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:00.606835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb47b8-549d-441a-b601-cf93841c39fa None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:00.642878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:00.643574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:00.643857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:00.644134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:00.644868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:00.645400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:00.646646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:00.661499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 650/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 23 15:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:27:00.667585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:00.771037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ad708-c04a-447f-9978-7c3b7e171d13 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:00.784806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:00.806024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:00.806824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:00.807126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:00.807422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:00.814470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:00.815951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:27:00.831435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:27:00.832551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 15:27:00.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 635/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 23 15:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:27:00.838706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:00.889707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:00.938898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf96d-bcad-4e80-9a12-7934433353e7 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:00.973281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:00.973948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:00.974231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:00.974504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:00.975325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:00.975634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:00.977062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213c13-5582-4940-8374-ec49b604d030 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:00.990601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 651/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 23 15:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:27:00.996747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:01.097561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af3917-83d7-4103-af7f-b8141b76368c None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:01.134490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:01.135163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:01.135447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:01.135723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:01.136556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] RBAC: Adding query filter params (role.id=cc12091eec434ea294a879c1b207931e, scope.project.id=7fd46ffdca084231b63751f121b988fc, user.id=99e4d094e08a4f1d92aed40961789f03) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:01.136866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:01.138293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd5de6-f3d8-4c79-a7c3-ca0da33a9969 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:01.144373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 636/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 23 15:27:00 2022] GET /identity/v3/role_assignments?user.id=99e4d094e08a4f1d92aed40961789f03&scope.project.id=7fd46ffdca084231b63751f121b988fc&role.id=cc12091eec434ea294a879c1b207931e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:27:03.410217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaf7d-e56a-4640-ba98-7d429b6c001e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:03.410861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaf7d-e56a-4640-ba98-7d429b6c001e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:03.410861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaf7d-e56a-4640-ba98-7d429b6c001e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:03.412433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 652/1288] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:27:03.418750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:03.419508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:03.419508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:03.437476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:27:03.438721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:27:03.478971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:03.519683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 637/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:27:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:27:03.543396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaf7d-e56a-4640-ba98-7d429b6c001e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:03.654910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaf7d-e56a-4640-ba98-7d429b6c001e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:03.667315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:03.692751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:03.693575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:03.693880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:03.694129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:03.696084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:03.696305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:27:03.709330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:27:03.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:03.711627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 653/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:27:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:27:03.716934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:03.837729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ca7ca-5777-4fa8-9036-88b59f2b66a1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:03.872883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:03.873562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:03.873848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:03.874130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:03.874850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:03.875186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:03.876555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7506c78-0b81-48a5-a30e-1ccd8eb623bf None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:03.882601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 638/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 23 15:27:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:27:03.887980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:03.986629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb41ab6-6959-4857-8fa8-bbd68cc28cd6 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:04.019677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:04.020388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:04.020671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:04.020947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] PATH_INFO: `/v3/services` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:04.021651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:04.021956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:04.023352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518840-135c-44d6-9b38-8340d6ac1ec1 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:04.028039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 654/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 23 15:27:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:27:06.260279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeea0f-e650-4f5f-95b3-f97d3814c438 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:06.260741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeea0f-e650-4f5f-95b3-f97d3814c438 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:06.260858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeea0f-e650-4f5f-95b3-f97d3814c438 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:06.262229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 639/1293] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:27:06.267316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09416be9-2d12-40a0-aba7-92fc65f863a2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:06.267693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09416be9-2d12-40a0-aba7-92fc65f863a2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:06.267872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09416be9-2d12-40a0-aba7-92fc65f863a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:06.285368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-09416be9-2d12-40a0-aba7-92fc65f863a2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:27:06.287079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-09416be9-2d12-40a0-aba7-92fc65f863a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:27:06.316456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:06.352513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 655/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:27:06.375819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeea0f-e650-4f5f-95b3-f97d3814c438 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:06.405739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:06.479956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeea0f-e650-4f5f-95b3-f97d3814c438 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:06.518184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f36c-7a57-4851-a5f7-9705da7a956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:06.518778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f36c-7a57-4851-a5f7-9705da7a956a None admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:06.519063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f36c-7a57-4851-a5f7-9705da7a956a None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:06.519372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f36c-7a57-4851-a5f7-9705da7a956a None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:06.520230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402f36c-7a57-4851-a5f7-9705da7a956a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:06.521617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402f36c-7a57-4851-a5f7-9705da7a956a None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:06.627650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 640/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 23 15:27:06 2022] POST /identity/v3/services => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:27:08.859897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b59dc-aaf2-45ac-8a41-c441e868066e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:08.860459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b59dc-aaf2-45ac-8a41-c441e868066e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:08.860459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b59dc-aaf2-45ac-8a41-c441e868066e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:08.861804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 656/1296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:27:08.867521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:08.867941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:08.868088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:08.884600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:27:08.885770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:27:08.961464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 641/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:27:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:27:08.985123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b59dc-aaf2-45ac-8a41-c441e868066e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:09.090653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b59dc-aaf2-45ac-8a41-c441e868066e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:09.124676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:09.125413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:09.125697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:09.125971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:09.126623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:09.128039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:27:09.140060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:27:09.147353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:09.148472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 657/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:27:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:27:09.149460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:09.167104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:09.246232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a47da-d8ff-4241-8eb0-329539b1a079 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:09.279583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:09.283695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:09.283695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:09.283695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:09.283695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:09.283695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:09.283695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:09.288676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 642/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 23 15:27:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:27:09.294756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:09.326375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:09.392388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232150-7c65-4671-9655-aeb64ed13fb9 None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:09.425074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:09.425724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:09.425999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:09.426316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:09.427104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] RBAC: Adding query filter params (interface=public, service_id=74736c551a6e4c84a7d131d56d2114ed, region_id=RegionOne) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:09.427435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:09.428865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f778b8-c177-4250-a23e-661edbb4f83a None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:09.434977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 658/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 23 15:27:09 2022] GET /identity/v3/endpoints?service_id=74736c551a6e4c84a7d131d56d2114ed&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:27:09.440673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:09.524246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:09.541917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba76b-d659-4db9-adc9-8fd41d9cfd42 None admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:09.576412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d49291-3565-45f8-b821-10c0d2c37c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:09.577080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d49291-3565-45f8-b821-10c0d2c37c40 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:09.577387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d49291-3565-45f8-b821-10c0d2c37c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:09.577724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d49291-3565-45f8-b821-10c0d2c37c40 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:09.578415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d49291-3565-45f8-b821-10c0d2c37c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:09.579803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d49291-3565-45f8-b821-10c0d2c37c40 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:09.587181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 643/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 23 15:27:09 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:27:11.817237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d77d-f61f-420d-85be-2ad7b843ceca None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:11.817800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d77d-f61f-420d-85be-2ad7b843ceca None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:11.817800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d77d-f61f-420d-85be-2ad7b843ceca None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:11.819181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 659/1302] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:27:11.824526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:11.824946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:11.825090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:11.841456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:27:11.842623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:27:11.916862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 644/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:27:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:27:11.939658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d77d-f61f-420d-85be-2ad7b843ceca None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:12.035327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:12.043239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d77d-f61f-420d-85be-2ad7b843ceca None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:12.076288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:12.076981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:12.077260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:12.077550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:12.078188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:12.079592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:27:12.091626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:27:12.092703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application with Lock( May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self._enter() May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application return self.creator() May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application created_value = creator( May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: ERROR keystone.server.flask.application May 23 15:27:12.094003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 660/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 23 15:27:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:27:12.105860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:12.181864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:12.204341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75e7ab-1d1b-4604-bb84-6a6a933adb37 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:12.239788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:12.240467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:12.241022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:12.242074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] PATH_INFO: `/v3/services` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:12.242793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:27:12.243120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:12.244503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a55f8-d520-4344-b66f-a92a0e3f9818 None admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:12.249938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 645/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 23 15:27:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:27:12.255836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:27:12.365453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea6982-c87d-4f4d-aed6-29f57b8c35ca None admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:27:12.399948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947847f-5405-4601-b825-260eba090886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:27:12.400618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947847f-5405-4601-b825-260eba090886 None admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:27:12.404689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947847f-5405-4601-b825-260eba090886 None admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:27:12.404689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947847f-5405-4601-b825-260eba090886 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:27:12.404689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947847f-5405-4601-b825-260eba090886 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:27:12.404689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947847f-5405-4601-b825-260eba090886 None admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:27:12.513347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 661/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 23 15:27:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:27:22.246738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=30 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:22.508535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.712830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405d42e-2ab3-45c2-ab6a-2f0e71e6c0c8 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.713400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405d42e-2ab3-45c2-ab6a-2f0e71e6c0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.713400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405d42e-2ab3-45c2-ab6a-2f0e71e6c0c8 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.714777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 646/1307] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:46.720276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9591a-5d28-42c0-a601-30469f567f2b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.720740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9591a-5d28-42c0-a601-30469f567f2b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.720822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9591a-5d28-42c0-a601-30469f567f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.799671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-89d9591a-5d28-42c0-a601-30469f567f2b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:46.801006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-89d9591a-5d28-42c0-a601-30469f567f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:46.931712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 662/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:35:46.991223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef0677-7a07-40fd-8f7c-5c291adf9287 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.991897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef0677-7a07-40fd-8f7c-5c291adf9287 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.992484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef0677-7a07-40fd-8f7c-5c291adf9287 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.994837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 647/1309] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 23 15:35:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:47.002597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152b05-b95c-443a-a262-6964a007f332 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.003291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152b05-b95c-443a-a262-6964a007f332 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.004079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152b05-b95c-443a-a262-6964a007f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.163265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3a152b05-b95c-443a-a262-6964a007f332 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:47.164824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3a152b05-b95c-443a-a262-6964a007f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:47.208091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.276213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 663/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 23 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:47.285526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef0677-7a07-40fd-8f7c-5c291adf9287 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.287985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c2ef0677-7a07-40fd-8f7c-5c291adf9287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:47.499148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef0677-7a07-40fd-8f7c-5c291adf9287 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.585561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.586885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.587203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.587490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.589789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:47.658512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.723936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.725439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e80c-83b7-4ee8-951a-3efc587c741a service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.746618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 648/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:35:50.483215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058909dc-2032-4b32-b61a-cd32811f0289 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.483742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058909dc-2032-4b32-b61a-cd32811f0289 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.483742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058909dc-2032-4b32-b61a-cd32811f0289 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.485135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 664/1312] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:50.491361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728df2a-5409-4c52-8c52-5bc35640aaf0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.491821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728df2a-5409-4c52-8c52-5bc35640aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.491926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728df2a-5409-4c52-8c52-5bc35640aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.574070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8728df2a-5409-4c52-8c52-5bc35640aaf0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:50.575303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8728df2a-5409-4c52-8c52-5bc35640aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:50.669315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 649/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:50.720247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e53d5-581c-462f-a453-c9789e9d12b2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.720535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e53d5-581c-462f-a453-c9789e9d12b2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.720812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e53d5-581c-462f-a453-c9789e9d12b2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.722241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 665/1314] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 23 15:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:50.728456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cef720-1de7-4694-86a5-54ad298854d9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.728819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cef720-1de7-4694-86a5-54ad298854d9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.729167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cef720-1de7-4694-86a5-54ad298854d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.740988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:50.812216 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a9cef720-1de7-4694-86a5-54ad298854d9 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:50.813574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a9cef720-1de7-4694-86a5-54ad298854d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:50.905729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 650/1315] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 23 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:50.915826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e53d5-581c-462f-a453-c9789e9d12b2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.917343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f87e53d5-581c-462f-a453-c9789e9d12b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:51.028522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e53d5-581c-462f-a453-c9789e9d12b2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:51.106230 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:51.109601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:51.110541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.111083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.111403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.113280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:51.233974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:51.235549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c91a1f-319c-4e27-852d-c0bc11694bad service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:51.256074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 666/1316] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:35:54.366993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520e5a7-ef92-474a-864e-4182ff980037 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.367587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520e5a7-ef92-474a-864e-4182ff980037 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.367587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520e5a7-ef92-474a-864e-4182ff980037 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.368948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 651/1317] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:54.374564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1aa4-da5c-4f68-80d9-4a8d1c983619 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.375050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1aa4-da5c-4f68-80d9-4a8d1c983619 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.375208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1aa4-da5c-4f68-80d9-4a8d1c983619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.445871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-893a1aa4-da5c-4f68-80d9-4a8d1c983619 None None] MFA Rules not processed for user `e2e7fa675dcd45a998f96ffcdc103e59`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:54.447568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-893a1aa4-da5c-4f68-80d9-4a8d1c983619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:54.504986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.552112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 667/1318] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:54.594375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520e5a7-ef92-474a-864e-4182ff980037 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.596066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2520e5a7-ef92-474a-864e-4182ff980037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:54.715400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520e5a7-ef92-474a-864e-4182ff980037 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.718339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.798380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.798948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.799275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.799561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.801333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:54.920016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:54.921466 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65540547-381d-446d-9847-c430d21a5a31 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.942276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 652/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:35:58.491288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abec0d-434a-4223-b7b3-a43accf8ed03 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:58.491848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abec0d-434a-4223-b7b3-a43accf8ed03 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:58.491848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abec0d-434a-4223-b7b3-a43accf8ed03 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:58.493178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 668/1320] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:58.498571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0a3e-eecf-4e47-9d34-a71a71e19c08 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:58.499022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0a3e-eecf-4e47-9d34-a71a71e19c08 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:58.499151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0a3e-eecf-4e47-9d34-a71a71e19c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:58.539463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:58.564831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-193c0a3e-eecf-4e47-9d34-a71a71e19c08 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:58.566048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-193c0a3e-eecf-4e47-9d34-a71a71e19c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:58.664940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 653/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:35:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:58.703797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abec0d-434a-4223-b7b3-a43accf8ed03 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:58.705322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a3abec0d-434a-4223-b7b3-a43accf8ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:58.819491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abec0d-434a-4223-b7b3-a43accf8ed03 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:58.895171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:58.895828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:58.896114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:58.896928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:58.898636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:58.906581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:59.011880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:59.013237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c29e1d-de56-4cf4-a767-7a443e69c251 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:59.032343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 669/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:35:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:02.659612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f4910-43c9-48c4-b379-5af5c30d8ff1 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.660328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f4910-43c9-48c4-b379-5af5c30d8ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.660328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f4910-43c9-48c4-b379-5af5c30d8ff1 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.661476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 654/1323] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:02.667751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee0b34-cae9-475f-b6a7-7a69176cfea0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.668216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee0b34-cae9-475f-b6a7-7a69176cfea0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.668462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee0b34-cae9-475f-b6a7-7a69176cfea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.761520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f2ee0b34-cae9-475f-b6a7-7a69176cfea0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:02.762761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f2ee0b34-cae9-475f-b6a7-7a69176cfea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:02.835922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.879285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 670/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:02.926830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f4910-43c9-48c4-b379-5af5c30d8ff1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.928601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-918f4910-43c9-48c4-b379-5af5c30d8ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:03.039421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f4910-43c9-48c4-b379-5af5c30d8ff1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:03.053914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:03.123118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:03.123785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:03.124067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:03.124343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:03.126004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:03.247487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:03.248939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de14ee-a464-41a1-b55a-cde64b0f71c5 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:03.268241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 655/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:05.569107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb213ca-deb3-48aa-8a9a-5714c164dd97 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.569649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb213ca-deb3-48aa-8a9a-5714c164dd97 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.569649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb213ca-deb3-48aa-8a9a-5714c164dd97 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.570939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 671/1326] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:05.576393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448542-399c-4037-900e-193ea0736419 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.576879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448542-399c-4037-900e-193ea0736419 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.577028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448542-399c-4037-900e-193ea0736419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.636891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.661425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4d448542-399c-4037-900e-193ea0736419 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:05.663245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4d448542-399c-4037-900e-193ea0736419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:05.789278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 656/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:05.834392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb213ca-deb3-48aa-8a9a-5714c164dd97 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.836143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9bb213ca-deb3-48aa-8a9a-5714c164dd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:05.951528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb213ca-deb3-48aa-8a9a-5714c164dd97 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.038062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.038813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.039198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.039660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.041490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:06.060555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.163200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.164574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2af63-e8e5-4fdf-ba95-572c949c74e2 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.190021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 672/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:08.821071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be37158-ed97-4f33-8389-4d40a5024a14 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.821690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be37158-ed97-4f33-8389-4d40a5024a14 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.821690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be37158-ed97-4f33-8389-4d40a5024a14 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.823004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 657/1329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:08.828734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2a1d-1a6e-42a6-a923-f312a8d39220 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.829388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2a1d-1a6e-42a6-a923-f312a8d39220 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.829388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2a1d-1a6e-42a6-a923-f312a8d39220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.900479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-86be2a1d-1a6e-42a6-a923-f312a8d39220 None None] MFA Rules not processed for user `e2e7fa675dcd45a998f96ffcdc103e59`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:08.901744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-86be2a1d-1a6e-42a6-a923-f312a8d39220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:08.974914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.013257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 673/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:09.051330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be37158-ed97-4f33-8389-4d40a5024a14 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:09.052908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0be37158-ed97-4f33-8389-4d40a5024a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:09.164203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be37158-ed97-4f33-8389-4d40a5024a14 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.187700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.252761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.253406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.253692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.253978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.256272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:09.372096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.373850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844c79-bef6-4aa2-a7b1-5c14021638d7 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.406430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 658/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:12.293660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373ed3-6245-40f9-9fe4-15d46962c916 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.294233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373ed3-6245-40f9-9fe4-15d46962c916 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.294233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373ed3-6245-40f9-9fe4-15d46962c916 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.295620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 674/1332] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:12.301067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e259ac1-b6fc-4c13-920f-cb34eeafc748 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.301484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e259ac1-b6fc-4c13-920f-cb34eeafc748 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.301631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e259ac1-b6fc-4c13-920f-cb34eeafc748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.369774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.372772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7e259ac1-b6fc-4c13-920f-cb34eeafc748 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:12.374011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7e259ac1-b6fc-4c13-920f-cb34eeafc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:12.491027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 659/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:12.527226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373ed3-6245-40f9-9fe4-15d46962c916 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.528794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9b373ed3-6245-40f9-9fe4-15d46962c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:12.653253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373ed3-6245-40f9-9fe4-15d46962c916 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.728553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.729361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.729661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.729936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.731672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:12.761917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.860333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.862042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52269f1-b9a9-478d-8437-bcf39d0187de service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.894380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 675/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:15.226153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694d642-9c10-4d7f-8e53-43864d8309d2 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.226692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694d642-9c10-4d7f-8e53-43864d8309d2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.226692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694d642-9c10-4d7f-8e53-43864d8309d2 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.228427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 660/1335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:15.234459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd5027-3d9b-4b31-b069-9c4a6d976e38 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.235037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd5027-3d9b-4b31-b069-9c4a6d976e38 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.235037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd5027-3d9b-4b31-b069-9c4a6d976e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.305420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-adfd5027-3d9b-4b31-b069-9c4a6d976e38 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:15.306647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-adfd5027-3d9b-4b31-b069-9c4a6d976e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:15.383982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.409109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 676/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:36:15.448622 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694d642-9c10-4d7f-8e53-43864d8309d2 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.450143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f694d642-9c10-4d7f-8e53-43864d8309d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:15.564151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694d642-9c10-4d7f-8e53-43864d8309d2 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.594408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.645568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.646784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.647065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.647370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.649037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:15.762353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.763818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5ad78-9e13-492b-8e03-b9e87e7d9cd9 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.785409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 661/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:36:19.124598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b897e8-3cae-408b-b464-f123cf6079e6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.125141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b897e8-3cae-408b-b464-f123cf6079e6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.125141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b897e8-3cae-408b-b464-f123cf6079e6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.126573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 677/1338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:19.133056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82d31-6e6f-4792-bed5-edbc8c0204b9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.133561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82d31-6e6f-4792-bed5-edbc8c0204b9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.133655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82d31-6e6f-4792-bed5-edbc8c0204b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.205575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c8a82d31-6e6f-4792-bed5-edbc8c0204b9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:19.206795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c8a82d31-6e6f-4792-bed5-edbc8c0204b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:19.216002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.314727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 662/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:19.351383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b897e8-3cae-408b-b464-f123cf6079e6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.354059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-48b897e8-3cae-408b-b464-f123cf6079e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:19.471734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b897e8-3cae-408b-b464-f123cf6079e6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.476142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22b74a-cb01-4152-b84c-2ac59e063b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.476793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22b74a-cb01-4152-b84c-2ac59e063b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.477075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22b74a-cb01-4152-b84c-2ac59e063b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.477356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22b74a-cb01-4152-b84c-2ac59e063b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.488361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22b74a-cb01-4152-b84c-2ac59e063b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.489281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22b74a-cb01-4152-b84c-2ac59e063b56 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.499842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 678/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:24.169069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f889c6-7ec5-4ea1-9527-80e61b018323 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.169542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f889c6-7ec5-4ea1-9527-80e61b018323 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.169713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f889c6-7ec5-4ea1-9527-80e61b018323 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.171034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 663/1341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:24.177664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62458af6-ab70-460f-bf1b-ccfdd6e67b45 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.177664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62458af6-ab70-460f-bf1b-ccfdd6e67b45 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.177664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62458af6-ab70-460f-bf1b-ccfdd6e67b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.212805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-62458af6-ab70-460f-bf1b-ccfdd6e67b45 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:24.214065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-62458af6-ab70-460f-bf1b-ccfdd6e67b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:24.319404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 679/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:24.357565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f889c6-7ec5-4ea1-9527-80e61b018323 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.369151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f889c6-7ec5-4ea1-9527-80e61b018323 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.372759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7eb3d-8390-484b-96de-150e8cc7f5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.373417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7eb3d-8390-484b-96de-150e8cc7f5da service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.373699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7eb3d-8390-484b-96de-150e8cc7f5da service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.374038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7eb3d-8390-484b-96de-150e8cc7f5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.388098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7eb3d-8390-484b-96de-150e8cc7f5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.389532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7eb3d-8390-484b-96de-150e8cc7f5da service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.399525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 664/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:27.755535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bf489-efd6-4f08-ad8e-e8cb50ea61cf None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.756317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bf489-efd6-4f08-ad8e-e8cb50ea61cf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.756317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bf489-efd6-4f08-ad8e-e8cb50ea61cf None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.758295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 680/1344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:27.763393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd5f8-212e-4d50-a97b-05398c6f0270 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.763393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd5f8-212e-4d50-a97b-05398c6f0270 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.763393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd5f8-212e-4d50-a97b-05398c6f0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.782333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a88dd5f8-212e-4d50-a97b-05398c6f0270 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:27.783577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a88dd5f8-212e-4d50-a97b-05398c6f0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:27.791617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 665/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:27.832070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bf489-efd6-4f08-ad8e-e8cb50ea61cf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.834666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9a0bf489-efd6-4f08-ad8e-e8cb50ea61cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:27.855689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bf489-efd6-4f08-ad8e-e8cb50ea61cf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.860896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3fd9-9587-4a60-9f60-6329e5fa9fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.861821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3fd9-9587-4a60-9f60-6329e5fa9fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.862105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3fd9-9587-4a60-9f60-6329e5fa9fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.862381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3fd9-9587-4a60-9f60-6329e5fa9fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.877650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3fd9-9587-4a60-9f60-6329e5fa9fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.879155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3fd9-9587-4a60-9f60-6329e5fa9fdf service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.889749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 681/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:33.062039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659823-2968-4a5e-9d19-1b8dd4ba773e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.062603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659823-2968-4a5e-9d19-1b8dd4ba773e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.062603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659823-2968-4a5e-9d19-1b8dd4ba773e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.063958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 666/1347] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:33.070279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029f74-60a1-45f3-a9d1-731ff91b8fc3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.071086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029f74-60a1-45f3-a9d1-731ff91b8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.071086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029f74-60a1-45f3-a9d1-731ff91b8fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.091726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-65029f74-60a1-45f3-a9d1-731ff91b8fc3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:33.092948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-65029f74-60a1-45f3-a9d1-731ff91b8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:33.101182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 682/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:33.144136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd659823-2968-4a5e-9d19-1b8dd4ba773e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.156333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd659823-2968-4a5e-9d19-1b8dd4ba773e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.160414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cee3c-80fa-4ff6-b1ef-c6b673603d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.161842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cee3c-80fa-4ff6-b1ef-c6b673603d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.161842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cee3c-80fa-4ff6-b1ef-c6b673603d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.161842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cee3c-80fa-4ff6-b1ef-c6b673603d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.187257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cee3c-80fa-4ff6-b1ef-c6b673603d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.187257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cee3c-80fa-4ff6-b1ef-c6b673603d16 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.187257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 667/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:38.910217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8017-aec3-4e09-80a9-172629b77f56 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.910746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8017-aec3-4e09-80a9-172629b77f56 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.910900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8017-aec3-4e09-80a9-172629b77f56 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.913546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 683/1350] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:38.922763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190716de-7319-4cf3-a2fe-9f573641541b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.922763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190716de-7319-4cf3-a2fe-9f573641541b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.922763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190716de-7319-4cf3-a2fe-9f573641541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.082307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-190716de-7319-4cf3-a2fe-9f573641541b None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:39.083605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-190716de-7319-4cf3-a2fe-9f573641541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:39.214493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.277539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 668/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:36:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:43.085783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.793022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf529a-8256-4978-a746-f6ce392abb8d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.793517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf529a-8256-4978-a746-f6ce392abb8d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.794306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf529a-8256-4978-a746-f6ce392abb8d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.796844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 684/1352] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:36:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:43.804267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24bf56-801a-4497-99dd-7dd18db33b62 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.804977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24bf56-801a-4497-99dd-7dd18db33b62 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.804977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24bf56-801a-4497-99dd-7dd18db33b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.834029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2f24bf56-801a-4497-99dd-7dd18db33b62 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:43.835399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2f24bf56-801a-4497-99dd-7dd18db33b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:43.844553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 669/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:45.602841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230f62-8ccd-40a9-b7ba-a57b3b4c451e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.603533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230f62-8ccd-40a9-b7ba-a57b3b4c451e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.603533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230f62-8ccd-40a9-b7ba-a57b3b4c451e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.604858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 685/1354] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:45.610356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79ebb-085a-41a6-946c-8e7e8ce4831a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.611015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79ebb-085a-41a6-946c-8e7e8ce4831a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.611015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79ebb-085a-41a6-946c-8e7e8ce4831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.631263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-eba79ebb-085a-41a6-946c-8e7e8ce4831a None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:45.632564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-eba79ebb-085a-41a6-946c-8e7e8ce4831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:45.641102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 670/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:36:49.656821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26499fd-5473-44ef-9908-2c0b761c3ad5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.657365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26499fd-5473-44ef-9908-2c0b761c3ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.657365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26499fd-5473-44ef-9908-2c0b761c3ad5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.658722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 686/1356] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:49.664095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210d831-cf07-410e-8deb-a4ba49fef71a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.664534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210d831-cf07-410e-8deb-a4ba49fef71a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.664671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210d831-cf07-410e-8deb-a4ba49fef71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.686035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7210d831-cf07-410e-8deb-a4ba49fef71a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:49.687321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7210d831-cf07-410e-8deb-a4ba49fef71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:49.703127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 671/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:49.761385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5d191-51b7-43fa-baa5-07458c53db33 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.761700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5d191-51b7-43fa-baa5-07458c53db33 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.762099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5d191-51b7-43fa-baa5-07458c53db33 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.766111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 687/1358] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 23 15:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:49.780897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a63fb-4af1-480d-bdbd-da87aa233db3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.780897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a63fb-4af1-480d-bdbd-da87aa233db3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.780897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a63fb-4af1-480d-bdbd-da87aa233db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.858741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bd9a63fb-4af1-480d-bdbd-da87aa233db3 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:49.860753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bd9a63fb-4af1-480d-bdbd-da87aa233db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:49.967641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 672/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 23 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:49.975699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5d191-51b7-43fa-baa5-07458c53db33 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.992478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5d191-51b7-43fa-baa5-07458c53db33 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:49.998381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fd575-827a-4d75-b748-9e32d173ea62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:49.999028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fd575-827a-4d75-b748-9e32d173ea62 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.999563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fd575-827a-4d75-b748-9e32d173ea62 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.999852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fd575-827a-4d75-b748-9e32d173ea62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.009207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fd575-827a-4d75-b748-9e32d173ea62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.010858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fd575-827a-4d75-b748-9e32d173ea62 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.021101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 688/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:52.852598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95bb44-7f98-40b6-a612-a40a13a45e39 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:52.853146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95bb44-7f98-40b6-a612-a40a13a45e39 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:52.853146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95bb44-7f98-40b6-a612-a40a13a45e39 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:52.854594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 673/1361] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:52.859821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e63d-d3b9-4e98-b8c7-183c98f5e845 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:52.860214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e63d-d3b9-4e98-b8c7-183c98f5e845 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:52.860374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e63d-d3b9-4e98-b8c7-183c98f5e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:52.878580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6d62e63d-d3b9-4e98-b8c7-183c98f5e845 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:52.880511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6d62e63d-d3b9-4e98-b8c7-183c98f5e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:52.888414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 689/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:52.932544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95bb44-7f98-40b6-a612-a40a13a45e39 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:52.948462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95bb44-7f98-40b6-a612-a40a13a45e39 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:52.954129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4837b9-1a6a-48a6-a20a-bb12bd971ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:52.954878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4837b9-1a6a-48a6-a20a-bb12bd971ee7 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:52.955313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4837b9-1a6a-48a6-a20a-bb12bd971ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:52.955676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4837b9-1a6a-48a6-a20a-bb12bd971ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:52.967271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4837b9-1a6a-48a6-a20a-bb12bd971ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:52.968991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4837b9-1a6a-48a6-a20a-bb12bd971ee7 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:52.979435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 674/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:55.899134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c492da-505d-4ac4-8039-82095444b7df None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.900126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c492da-505d-4ac4-8039-82095444b7df None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.900620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c492da-505d-4ac4-8039-82095444b7df None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.902520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 690/1364] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:55.909338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713882e0-391e-45ef-9d8d-b7d8376acba5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.910251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713882e0-391e-45ef-9d8d-b7d8376acba5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.911181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713882e0-391e-45ef-9d8d-b7d8376acba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.938879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-713882e0-391e-45ef-9d8d-b7d8376acba5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:55.940074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-713882e0-391e-45ef-9d8d-b7d8376acba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:55.956227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 675/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:36:56.005080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d16a9-fac0-4bf4-bf15-054db26b025f None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.005370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d16a9-fac0-4bf4-bf15-054db26b025f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.005675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d16a9-fac0-4bf4-bf15-054db26b025f None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.007043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 691/1366] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 23 15:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:56.012649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ba3a-0bf9-4e06-b64d-f4176ed3a535 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.012916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ba3a-0bf9-4e06-b64d-f4176ed3a535 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.013268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ba3a-0bf9-4e06-b64d-f4176ed3a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.032322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-aef2ba3a-0bf9-4e06-b64d-f4176ed3a535 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:56.033505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-aef2ba3a-0bf9-4e06-b64d-f4176ed3a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:56.043691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 676/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 23 15:36:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:56.052029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d16a9-fac0-4bf4-bf15-054db26b025f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:56.069218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d16a9-fac0-4bf4-bf15-054db26b025f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:56.074729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160cd65-522a-4b6f-b534-16901b9e6e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:56.075409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160cd65-522a-4b6f-b534-16901b9e6e36 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.075686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160cd65-522a-4b6f-b534-16901b9e6e36 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.075962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160cd65-522a-4b6f-b534-16901b9e6e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.085118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160cd65-522a-4b6f-b534-16901b9e6e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:56.086750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160cd65-522a-4b6f-b534-16901b9e6e36 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:56.097936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 692/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:36:58.590725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508a6b-8b3b-4784-b3e4-15d5bd3d1f7e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.591461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508a6b-8b3b-4784-b3e4-15d5bd3d1f7e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.591461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508a6b-8b3b-4784-b3e4-15d5bd3d1f7e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.593082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 677/1369] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:58.599074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371064f3-2776-4f94-a86d-0e463e6efcff None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.601321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371064f3-2776-4f94-a86d-0e463e6efcff None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.601845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371064f3-2776-4f94-a86d-0e463e6efcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.621853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-371064f3-2776-4f94-a86d-0e463e6efcff None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:58.623072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-371064f3-2776-4f94-a86d-0e463e6efcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:58.631413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 693/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:58.679359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508a6b-8b3b-4784-b3e4-15d5bd3d1f7e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.695897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508a6b-8b3b-4784-b3e4-15d5bd3d1f7e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.701862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38c0c4-dacc-42ca-a798-3b47f7ebd8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.702560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c0c4-dacc-42ca-a798-3b47f7ebd8f1 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.702845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c0c4-dacc-42ca-a798-3b47f7ebd8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.703159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c0c4-dacc-42ca-a798-3b47f7ebd8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.713972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38c0c4-dacc-42ca-a798-3b47f7ebd8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:58.715739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38c0c4-dacc-42ca-a798-3b47f7ebd8f1 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:58.727172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 678/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:36:58.899854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49594-60b7-4393-a06f-cacfe9d0c7ee None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.900114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49594-60b7-4393-a06f-cacfe9d0c7ee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.900266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49594-60b7-4393-a06f-cacfe9d0c7ee None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.901640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 694/1372] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:58.907282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc426b5-229a-4180-95fd-ab507f5b90b8 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.907678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc426b5-229a-4180-95fd-ab507f5b90b8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.908037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc426b5-229a-4180-95fd-ab507f5b90b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.927308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-0bc426b5-229a-4180-95fd-ab507f5b90b8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:58.928804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0bc426b5-229a-4180-95fd-ab507f5b90b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:58.945009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 679/1373] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:59.334206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb9e81-9b1a-4a04-bbb8-9ed9fcb62349 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.334645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb9e81-9b1a-4a04-bbb8-9ed9fcb62349 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.335075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb9e81-9b1a-4a04-bbb8-9ed9fcb62349 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.337532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 695/1374] 10.222.0.32 () {54 vars in 963 bytes} [Mon May 23 15:36:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:59.346769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8a70-20f3-4fd5-9f00-7dfe171c4114 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.347248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8a70-20f3-4fd5-9f00-7dfe171c4114 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.347678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8a70-20f3-4fd5-9f00-7dfe171c4114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.420833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-635f8a70-20f3-4fd5-9f00-7dfe171c4114 None None] MFA Rules not processed for user `2edb5d30e76d488491a9d7c38b3300f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:59.422415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-635f8a70-20f3-4fd5-9f00-7dfe171c4114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:59.428443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.504780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 680/1375] 10.222.0.32 () {58 vars in 1060 bytes} [Mon May 23 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:59.513424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb9e81-9b1a-4a04-bbb8-9ed9fcb62349 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.535414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb9e81-9b1a-4a04-bbb8-9ed9fcb62349 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.541511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a49d2-8934-4030-b248-8ef634d41ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.542598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a49d2-8934-4030-b248-8ef634d41ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.543125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a49d2-8934-4030-b248-8ef634d41ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.543650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a49d2-8934-4030-b248-8ef634d41ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.560832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a49d2-8934-4030-b248-8ef634d41ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.563370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a49d2-8934-4030-b248-8ef634d41ef3 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.579936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 696/1376] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:01.321653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855adfd7-0b04-460d-a0b1-1c46cc6ae47e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.322263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855adfd7-0b04-460d-a0b1-1c46cc6ae47e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.322263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855adfd7-0b04-460d-a0b1-1c46cc6ae47e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.323648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 681/1377] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:01.328982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01416f7-fde5-4993-bcd0-63cb397d1eb3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.329401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01416f7-fde5-4993-bcd0-63cb397d1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.329540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01416f7-fde5-4993-bcd0-63cb397d1eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.348918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e01416f7-fde5-4993-bcd0-63cb397d1eb3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:01.350142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e01416f7-fde5-4993-bcd0-63cb397d1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:01.359155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 697/1378] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:01.407795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855adfd7-0b04-460d-a0b1-1c46cc6ae47e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:01.429933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855adfd7-0b04-460d-a0b1-1c46cc6ae47e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:01.438261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9e3e6-6673-4c21-b889-f6d15e8619b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:01.439429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e3e6-6673-4c21-b889-f6d15e8619b8 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.439938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e3e6-6673-4c21-b889-f6d15e8619b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.440432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e3e6-6673-4c21-b889-f6d15e8619b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.456788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9e3e6-6673-4c21-b889-f6d15e8619b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:01.458794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9e3e6-6673-4c21-b889-f6d15e8619b8 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:01.473418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 682/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:04.085859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8e29-dcfe-4a78-9ca3-95add18e9b00 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.086378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8e29-dcfe-4a78-9ca3-95add18e9b00 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.086378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8e29-dcfe-4a78-9ca3-95add18e9b00 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.089841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 698/1380] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:04.093744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e109b4-39d4-442a-a645-748842757bd7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.094591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e109b4-39d4-442a-a645-748842757bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.094591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e109b4-39d4-442a-a645-748842757bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.117247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-42e109b4-39d4-442a-a645-748842757bd7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:04.119133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-42e109b4-39d4-442a-a645-748842757bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:04.130877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 683/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:37:04.180319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8e29-dcfe-4a78-9ca3-95add18e9b00 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:04.207262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8e29-dcfe-4a78-9ca3-95add18e9b00 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:04.216962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc998da1-70cb-4630-ba4d-65905ee68d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:04.216962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc998da1-70cb-4630-ba4d-65905ee68d98 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.217420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc998da1-70cb-4630-ba4d-65905ee68d98 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.217741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc998da1-70cb-4630-ba4d-65905ee68d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.229764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc998da1-70cb-4630-ba4d-65905ee68d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:04.232145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc998da1-70cb-4630-ba4d-65905ee68d98 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:04.249762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 699/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:06.976119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333c705-aff4-471d-92e7-ee52e66d93a6 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.976865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333c705-aff4-471d-92e7-ee52e66d93a6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.977014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333c705-aff4-471d-92e7-ee52e66d93a6 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.979282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 684/1383] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:06.987985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb924-ecfa-4099-b0ec-36e36ff6dd16 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.988780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb924-ecfa-4099-b0ec-36e36ff6dd16 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.988903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb924-ecfa-4099-b0ec-36e36ff6dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:07.015995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0a4fb924-ecfa-4099-b0ec-36e36ff6dd16 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:07.018274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0a4fb924-ecfa-4099-b0ec-36e36ff6dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:07.032894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 700/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:07.097478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333c705-aff4-471d-92e7-ee52e66d93a6 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:07.117051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333c705-aff4-471d-92e7-ee52e66d93a6 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:07.122892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c5ee-95e7-47ea-a8b2-3bbdd6d1835a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:07.123576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c5ee-95e7-47ea-a8b2-3bbdd6d1835a service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:07.123889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c5ee-95e7-47ea-a8b2-3bbdd6d1835a service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:07.124396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c5ee-95e7-47ea-a8b2-3bbdd6d1835a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:07.138180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29c5ee-95e7-47ea-a8b2-3bbdd6d1835a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:07.140426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29c5ee-95e7-47ea-a8b2-3bbdd6d1835a service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:07.172387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 685/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:09.797651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9c46-c190-4fe1-a7c6-f4907332563d None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.798475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9c46-c190-4fe1-a7c6-f4907332563d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.798751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9c46-c190-4fe1-a7c6-f4907332563d None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.802436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 701/1386] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:09.810410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9dc5-6b42-4f61-af89-53d8e3f4ecd1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.811020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9dc5-6b42-4f61-af89-53d8e3f4ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.811020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9dc5-6b42-4f61-af89-53d8e3f4ecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.834697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-247f9dc5-6b42-4f61-af89-53d8e3f4ecd1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:09.836118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-247f9dc5-6b42-4f61-af89-53d8e3f4ecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:09.847678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 686/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:09.918276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9c46-c190-4fe1-a7c6-f4907332563d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.943086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9c46-c190-4fe1-a7c6-f4907332563d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.951374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383408-673b-4373-83a1-d882f40ef331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.952496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383408-673b-4373-83a1-d882f40ef331 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.953007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383408-673b-4373-83a1-d882f40ef331 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.953454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383408-673b-4373-83a1-d882f40ef331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.966987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383408-673b-4373-83a1-d882f40ef331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.969572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383408-673b-4373-83a1-d882f40ef331 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.987717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 702/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:12.739178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc7d41-303c-482a-be4b-b854237eda81 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.739760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc7d41-303c-482a-be4b-b854237eda81 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.739760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc7d41-303c-482a-be4b-b854237eda81 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.741149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 687/1389] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:12.748581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d23a-c853-4d13-b676-f0d72631fcdb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.749251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d23a-c853-4d13-b676-f0d72631fcdb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.749519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d23a-c853-4d13-b676-f0d72631fcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.772843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6657d23a-c853-4d13-b676-f0d72631fcdb None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:12.774435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6657d23a-c853-4d13-b676-f0d72631fcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:12.785655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 703/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:12.846638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc7d41-303c-482a-be4b-b854237eda81 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.865483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc7d41-303c-482a-be4b-b854237eda81 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:12.872725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87f724-1e06-4352-8ba4-d2a4811d3e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:12.873549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87f724-1e06-4352-8ba4-d2a4811d3e1c service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.873920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87f724-1e06-4352-8ba4-d2a4811d3e1c service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.874275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87f724-1e06-4352-8ba4-d2a4811d3e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.886798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87f724-1e06-4352-8ba4-d2a4811d3e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:12.888978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87f724-1e06-4352-8ba4-d2a4811d3e1c service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:12.905993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 688/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:15.405694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7aa1-ba93-4bfb-aed4-5a1f5a227e9a None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.406308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7aa1-ba93-4bfb-aed4-5a1f5a227e9a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.406308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7aa1-ba93-4bfb-aed4-5a1f5a227e9a None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.407804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 704/1392] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:15.413368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7044-cbee-41ff-b4c3-d8e83bec52e8 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.424361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7044-cbee-41ff-b4c3-d8e83bec52e8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.424361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7044-cbee-41ff-b4c3-d8e83bec52e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.432842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-be7a7044-cbee-41ff-b4c3-d8e83bec52e8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:15.434166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-be7a7044-cbee-41ff-b4c3-d8e83bec52e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:15.442834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 689/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:15.493466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7aa1-ba93-4bfb-aed4-5a1f5a227e9a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:15.505424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=46 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:15.514078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7aa1-ba93-4bfb-aed4-5a1f5a227e9a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:15.522406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8455-245e-47eb-a9ba-0d69230c85f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:15.523463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8455-245e-47eb-a9ba-0d69230c85f4 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.523898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8455-245e-47eb-a9ba-0d69230c85f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.524303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8455-245e-47eb-a9ba-0d69230c85f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.533714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8455-245e-47eb-a9ba-0d69230c85f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:15.535389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8455-245e-47eb-a9ba-0d69230c85f4 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:15.546620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 705/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:16.727703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ddf73-f54e-447f-8a43-cfd98589f413 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.728244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ddf73-f54e-447f-8a43-cfd98589f413 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.728244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ddf73-f54e-447f-8a43-cfd98589f413 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.729608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 690/1395] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:16.734946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ddda-a96c-4519-8835-8eca0a522073 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.735692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ddda-a96c-4519-8835-8eca0a522073 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.735692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ddda-a96c-4519-8835-8eca0a522073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.754554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5bb5ddda-a96c-4519-8835-8eca0a522073 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:16.755776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5bb5ddda-a96c-4519-8835-8eca0a522073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:16.763848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 706/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:16.824515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482e66-036f-481c-8811-0168b30afd9e None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.824807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482e66-036f-481c-8811-0168b30afd9e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.825092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482e66-036f-481c-8811-0168b30afd9e None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.826463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 691/1397] 10.222.0.32 () {54 vars in 962 bytes} [Mon May 23 15:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:16.832232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a5cb7-c8a1-4836-ad8f-03697be98ee6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.832522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a5cb7-c8a1-4836-ad8f-03697be98ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.832799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a5cb7-c8a1-4836-ad8f-03697be98ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.899041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-507a5cb7-c8a1-4836-ad8f-03697be98ee6 None None] MFA Rules not processed for user `43d6df3eff264a17a0b970c7fa9eef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:16.900280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-507a5cb7-c8a1-4836-ad8f-03697be98ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:16.966813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 707/1398] 10.222.0.32 () {58 vars in 1059 bytes} [Mon May 23 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:16.975702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482e66-036f-481c-8811-0168b30afd9e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:16.990146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482e66-036f-481c-8811-0168b30afd9e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:16.993319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a37130-0cc9-41f6-bf65-304d38bfe074 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:16.993973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a37130-0cc9-41f6-bf65-304d38bfe074 service glance] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.994256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a37130-0cc9-41f6-bf65-304d38bfe074 service glance] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.994653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a37130-0cc9-41f6-bf65-304d38bfe074 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.004558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a37130-0cc9-41f6-bf65-304d38bfe074 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:17.005993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a37130-0cc9-41f6-bf65-304d38bfe074 service glance] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:17.017230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 692/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:17.784912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7945049-d928-436b-80f2-287681f0d259 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.789728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7945049-d928-436b-80f2-287681f0d259 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.789728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7945049-d928-436b-80f2-287681f0d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.853862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f7945049-d928-436b-80f2-287681f0d259 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:17.855008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f7945049-d928-436b-80f2-287681f0d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:17.928150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 708/1400] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:17.975086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbc66a-ff8b-4c00-abbc-e3fb3b4a9ae3 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.975953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbc66a-ff8b-4c00-abbc-e3fb3b4a9ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.975953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbc66a-ff8b-4c00-abbc-e3fb3b4a9ae3 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.977067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 693/1401] 10.222.0.32 () {54 vars in 942 bytes} [Mon May 23 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:17.983840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.984133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.984418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.010884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b918c-f001-422c-a49d-c166b2138ab7 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.011208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b918c-f001-422c-a49d-c166b2138ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.011497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b918c-f001-422c-a49d-c166b2138ab7 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.012868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 694/1402] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:18.019122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.019751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.019751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.035197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:18.038116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:18.038840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] MFA Rules not processed for user `c2deaa48dbdb477f971178bd535395a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:18.039360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:18.039488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:18.048610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 695/1403] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:37:18.093103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.106554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b032e0-aed6-46cd-a88e-df533e520c59 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.112447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2554e72-1084-4089-8230-db1ba363e7d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.113106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554e72-1084-4089-8230-db1ba363e7d4 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.113936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554e72-1084-4089-8230-db1ba363e7d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.114218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554e72-1084-4089-8230-db1ba363e7d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.121431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 709/1404] 10.222.0.32 () {58 vars in 1039 bytes} [Mon May 23 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:18.124188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2554e72-1084-4089-8230-db1ba363e7d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.126301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2554e72-1084-4089-8230-db1ba363e7d4 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.131879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.137672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 696/1405] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:37:18.141533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08a985-f1a1-4b02-bb2c-4cf29a2ac121 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.146724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64561d64-a08b-4ac0-9a81-439648f43c2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.147414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64561d64-a08b-4ac0-9a81-439648f43c2d service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.147699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64561d64-a08b-4ac0-9a81-439648f43c2d service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.147976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64561d64-a08b-4ac0-9a81-439648f43c2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.157149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64561d64-a08b-4ac0-9a81-439648f43c2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.158764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64561d64-a08b-4ac0-9a81-439648f43c2d service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.167053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 710/1406] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:37:20.810822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5344-36b9-410b-8aa0-db4c483cd56b None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:20.811821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5344-36b9-410b-8aa0-db4c483cd56b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:20.812296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5344-36b9-410b-8aa0-db4c483cd56b None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:20.820109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4f12-696e-4282-99c4-7e31d831335b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:20.820659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4f12-696e-4282-99c4-7e31d831335b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:20.820911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4f12-696e-4282-99c4-7e31d831335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:20.823005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 697/1407] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:37:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:20.842966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c01c4f12-696e-4282-99c4-7e31d831335b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:20.844757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c01c4f12-696e-4282-99c4-7e31d831335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:20.853133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 711/1408] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:37:20.905461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5344-36b9-410b-8aa0-db4c483cd56b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:20.921298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5344-36b9-410b-8aa0-db4c483cd56b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:20.927758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42892b23-ddee-44b9-840f-c0ba560081f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:20.928574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42892b23-ddee-44b9-840f-c0ba560081f7 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:20.928922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42892b23-ddee-44b9-840f-c0ba560081f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:20.929271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42892b23-ddee-44b9-840f-c0ba560081f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:20.940817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42892b23-ddee-44b9-840f-c0ba560081f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:20.942596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42892b23-ddee-44b9-840f-c0ba560081f7 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:20.955437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 698/1409] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:30.837233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=39 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:30.950262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=71 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:42.963400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebac24-2221-47e3-bc85-664edb964db0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:42.964023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebac24-2221-47e3-bc85-664edb964db0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:42.964023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebac24-2221-47e3-bc85-664edb964db0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:42.965342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 712/1410] 10.222.0.32 () {54 vars in 918 bytes} [Mon May 23 15:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:42.970680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b529d9-e9d6-48bd-9b6e-0579fd017935 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:42.971190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b529d9-e9d6-48bd-9b6e-0579fd017935 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:42.971290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b529d9-e9d6-48bd-9b6e-0579fd017935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:42.991259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e3b529d9-e9d6-48bd-9b6e-0579fd017935 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:42.992439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e3b529d9-e9d6-48bd-9b6e-0579fd017935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:43.001437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 699/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Mon May 23 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:43.015899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241d1fb-caae-4ff0-b839-8bbe0b9c351c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:43.016185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241d1fb-caae-4ff0-b839-8bbe0b9c351c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:43.016463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241d1fb-caae-4ff0-b839-8bbe0b9c351c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:43.017810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 713/1412] 10.222.0.32 () {54 vars in 918 bytes} [Mon May 23 15:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:43.022439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d27c-7381-426f-8bd1-4e2411445545 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:43.022733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d27c-7381-426f-8bd1-4e2411445545 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:43.023045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d27c-7381-426f-8bd1-4e2411445545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:43.041924 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-6256d27c-7381-426f-8bd1-4e2411445545 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:43.043178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6256d27c-7381-426f-8bd1-4e2411445545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:43.053718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 700/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Mon May 23 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:45.770209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566e2e-71f9-4352-9f1a-5f8203180f52 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:45.770788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566e2e-71f9-4352-9f1a-5f8203180f52 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:45.770788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566e2e-71f9-4352-9f1a-5f8203180f52 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:45.772189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:45.778217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a84ad-452a-4fc9-a759-aef302f3c00c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:45.778737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a84ad-452a-4fc9-a759-aef302f3c00c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:45.778857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a84ad-452a-4fc9-a759-aef302f3c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:45.797509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-600a84ad-452a-4fc9-a759-aef302f3c00c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:45.798707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-600a84ad-452a-4fc9-a759-aef302f3c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:45.806919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:45.850698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566e2e-71f9-4352-9f1a-5f8203180f52 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:45.866138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566e2e-71f9-4352-9f1a-5f8203180f52 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:45.871749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149c451-0602-4b2c-839b-708aa89a1de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:45.872422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149c451-0602-4b2c-839b-708aa89a1de8 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:45.872715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149c451-0602-4b2c-839b-708aa89a1de8 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:45.872997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149c451-0602-4b2c-839b-708aa89a1de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:45.883413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149c451-0602-4b2c-839b-708aa89a1de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:45.885109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149c451-0602-4b2c-839b-708aa89a1de8 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:45.896139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 715/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:46.883573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cbd66-6c80-4a45-bb77-147d008d6155 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:46.884116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cbd66-6c80-4a45-bb77-147d008d6155 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:46.884116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cbd66-6c80-4a45-bb77-147d008d6155 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:46.885496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:46.890711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11adb2-1933-409c-8a3f-9652c2a54003 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:46.891219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11adb2-1933-409c-8a3f-9652c2a54003 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:46.891328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11adb2-1933-409c-8a3f-9652c2a54003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:46.909847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8b11adb2-1933-409c-8a3f-9652c2a54003 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:46.911054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8b11adb2-1933-409c-8a3f-9652c2a54003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:46.918988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:47.090699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cbd66-6c80-4a45-bb77-147d008d6155 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:47.105087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cbd66-6c80-4a45-bb77-147d008d6155 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:47.110443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bccdc7-8882-4281-b640-9e08b0f8c90d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:47.111070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bccdc7-8882-4281-b640-9e08b0f8c90d service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:47.111381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bccdc7-8882-4281-b640-9e08b0f8c90d service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:47.111679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bccdc7-8882-4281-b640-9e08b0f8c90d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:47.120832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bccdc7-8882-4281-b640-9e08b0f8c90d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:47.122418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bccdc7-8882-4281-b640-9e08b0f8c90d service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:47.132795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 703/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:48.077052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da771e66-c743-480c-8756-b06028ce55a6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:48.077631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da771e66-c743-480c-8756-b06028ce55a6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:48.077631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da771e66-c743-480c-8756-b06028ce55a6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:48.078960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:48.084893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806038e0-f6b6-4a17-b970-945bb95bb627 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:48.085300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806038e0-f6b6-4a17-b970-945bb95bb627 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:48.085460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806038e0-f6b6-4a17-b970-945bb95bb627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:48.104210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-806038e0-f6b6-4a17-b970-945bb95bb627 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:48.105412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-806038e0-f6b6-4a17-b970-945bb95bb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:48.113510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:48.266265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da771e66-c743-480c-8756-b06028ce55a6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:48.281608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da771e66-c743-480c-8756-b06028ce55a6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:48.286986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ab9c8-15a9-413b-bbfa-1340a282b35a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:48.287655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ab9c8-15a9-413b-bbfa-1340a282b35a service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:48.287937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ab9c8-15a9-413b-bbfa-1340a282b35a service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:48.288214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ab9c8-15a9-413b-bbfa-1340a282b35a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:48.296598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ab9c8-15a9-413b-bbfa-1340a282b35a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:48.298174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ab9c8-15a9-413b-bbfa-1340a282b35a service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:48.307602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 718/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:49.220423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ade36-b905-457b-8bae-d3ec0d41f311 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:49.220958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ade36-b905-457b-8bae-d3ec0d41f311 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:49.221326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ade36-b905-457b-8bae-d3ec0d41f311 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:49.224479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:49.230237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dfb07-0c6b-46d3-ba86-0ef77d590d6a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:49.230790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dfb07-0c6b-46d3-ba86-0ef77d590d6a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:49.230790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dfb07-0c6b-46d3-ba86-0ef77d590d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:49.254920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-599dfb07-0c6b-46d3-ba86-0ef77d590d6a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:49.256186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-599dfb07-0c6b-46d3-ba86-0ef77d590d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:49.264251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:49.415537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ade36-b905-457b-8bae-d3ec0d41f311 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:49.430190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ade36-b905-457b-8bae-d3ec0d41f311 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:49.435706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384babb-7d97-46b1-96d7-ecfd254cd4e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:49.436346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384babb-7d97-46b1-96d7-ecfd254cd4e0 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:49.436630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384babb-7d97-46b1-96d7-ecfd254cd4e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:49.436910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384babb-7d97-46b1-96d7-ecfd254cd4e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:49.445455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384babb-7d97-46b1-96d7-ecfd254cd4e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:49.447075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384babb-7d97-46b1-96d7-ecfd254cd4e0 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:49.457225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 706/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:50.392348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3c4d3-4fb7-44b2-bf26-ff06074a0d83 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.392916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3c4d3-4fb7-44b2-bf26-ff06074a0d83 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.392916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3c4d3-4fb7-44b2-bf26-ff06074a0d83 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.394306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:50.405179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d8748-9f92-4e56-ada7-dc8045de9d90 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.405635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d8748-9f92-4e56-ada7-dc8045de9d90 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.405733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d8748-9f92-4e56-ada7-dc8045de9d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.427382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f96d8748-9f92-4e56-ada7-dc8045de9d90 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:50.428637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f96d8748-9f92-4e56-ada7-dc8045de9d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:50.436757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:37:50.587488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3c4d3-4fb7-44b2-bf26-ff06074a0d83 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:50.602546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3c4d3-4fb7-44b2-bf26-ff06074a0d83 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:50.608489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4699aa-1c52-44b9-a49a-e3dafe4d8a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:50.609135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4699aa-1c52-44b9-a49a-e3dafe4d8a5e service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.609423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4699aa-1c52-44b9-a49a-e3dafe4d8a5e service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.609706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4699aa-1c52-44b9-a49a-e3dafe4d8a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.619440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4699aa-1c52-44b9-a49a-e3dafe4d8a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:50.621035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4699aa-1c52-44b9-a49a-e3dafe4d8a5e service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:50.630552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 721/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:51.631695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af825-e290-4568-98ad-587aa350160a None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:51.632237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af825-e290-4568-98ad-587aa350160a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:51.632237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af825-e290-4568-98ad-587aa350160a None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:51.633553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:51.639190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed66da-ccd6-4e15-9172-89dd57a86dce None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:51.639655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed66da-ccd6-4e15-9172-89dd57a86dce None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:51.639765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed66da-ccd6-4e15-9172-89dd57a86dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:51.657607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c4ed66da-ccd6-4e15-9172-89dd57a86dce None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:51.658855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c4ed66da-ccd6-4e15-9172-89dd57a86dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:51.666792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:51.817314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40af825-e290-4568-98ad-587aa350160a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:51.831907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40af825-e290-4568-98ad-587aa350160a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:51.837501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041bea8-08be-441d-ac11-bf2e579418cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:51.838152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041bea8-08be-441d-ac11-bf2e579418cc service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:51.838440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041bea8-08be-441d-ac11-bf2e579418cc service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:51.838723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041bea8-08be-441d-ac11-bf2e579418cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:51.847511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041bea8-08be-441d-ac11-bf2e579418cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:51.849096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041bea8-08be-441d-ac11-bf2e579418cc service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:51.858651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 709/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:52.819641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb4d7-f167-4e26-85d1-1171314139c7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:52.820070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb4d7-f167-4e26-85d1-1171314139c7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:52.820204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb4d7-f167-4e26-85d1-1171314139c7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:52.821800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:52.827264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fa485-b698-4864-8407-0cf7d3b4831d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:52.827757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fa485-b698-4864-8407-0cf7d3b4831d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:52.827914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fa485-b698-4864-8407-0cf7d3b4831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:52.846658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-5a3fa485-b698-4864-8407-0cf7d3b4831d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:52.847897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5a3fa485-b698-4864-8407-0cf7d3b4831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:52.856552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:53.008900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb4d7-f167-4e26-85d1-1171314139c7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:53.025771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb4d7-f167-4e26-85d1-1171314139c7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:53.040914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1992-b9ce-4653-ba39-37dd40e74f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:53.041591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1992-b9ce-4653-ba39-37dd40e74f37 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:53.042036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1992-b9ce-4653-ba39-37dd40e74f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:53.042553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1992-b9ce-4653-ba39-37dd40e74f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:53.053688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1992-b9ce-4653-ba39-37dd40e74f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:53.055339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1992-b9ce-4653-ba39-37dd40e74f37 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:53.065089 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 724/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:37:54.011811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa41c03-46e7-4916-b146-fb36de4f1869 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:54.012406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa41c03-46e7-4916-b146-fb36de4f1869 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:54.012406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa41c03-46e7-4916-b146-fb36de4f1869 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:54.013983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:54.020021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41dc99-658f-40d1-a59f-8aa7c518e404 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:54.020544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41dc99-658f-40d1-a59f-8aa7c518e404 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:54.020645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41dc99-658f-40d1-a59f-8aa7c518e404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:54.039400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5d41dc99-658f-40d1-a59f-8aa7c518e404 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:54.040632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5d41dc99-658f-40d1-a59f-8aa7c518e404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:54.048523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:54.199149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa41c03-46e7-4916-b146-fb36de4f1869 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:54.213319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa41c03-46e7-4916-b146-fb36de4f1869 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:54.218781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736490-87c2-4d4f-ad56-b9e280cd4f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:54.219493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736490-87c2-4d4f-ad56-b9e280cd4f5a service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:54.219778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736490-87c2-4d4f-ad56-b9e280cd4f5a service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:54.220054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736490-87c2-4d4f-ad56-b9e280cd4f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:54.229025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736490-87c2-4d4f-ad56-b9e280cd4f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:54.230739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736490-87c2-4d4f-ad56-b9e280cd4f5a service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:54.242912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 712/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:55.211679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff819ee4-94a8-415e-a820-2be61f2b2407 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.212217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff819ee4-94a8-415e-a820-2be61f2b2407 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.212217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff819ee4-94a8-415e-a820-2be61f2b2407 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.213549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:55.218510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f1728-cbdb-40e7-9a1d-ff4c900fec72 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.218925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f1728-cbdb-40e7-9a1d-ff4c900fec72 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.219071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f1728-cbdb-40e7-9a1d-ff4c900fec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.237657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ed0f1728-cbdb-40e7-9a1d-ff4c900fec72 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:55.238876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ed0f1728-cbdb-40e7-9a1d-ff4c900fec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:55.247015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:55.397323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff819ee4-94a8-415e-a820-2be61f2b2407 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:55.411644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff819ee4-94a8-415e-a820-2be61f2b2407 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:55.417078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f890ab-d9da-4bc2-9664-9a0bfac88744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:55.417725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f890ab-d9da-4bc2-9664-9a0bfac88744 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.418036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f890ab-d9da-4bc2-9664-9a0bfac88744 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.418318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f890ab-d9da-4bc2-9664-9a0bfac88744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.427329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f890ab-d9da-4bc2-9664-9a0bfac88744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:55.428924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f890ab-d9da-4bc2-9664-9a0bfac88744 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:55.438340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 727/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:57.578700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a389-fe94-49dc-8b7d-600db4c4c0d5 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:57.579318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a389-fe94-49dc-8b7d-600db4c4c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:57.579318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a389-fe94-49dc-8b7d-600db4c4c0d5 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:57.580578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:57.586613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ebff-9914-4fe3-9eb0-5a531915ee33 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:57.587070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ebff-9914-4fe3-9eb0-5a531915ee33 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:57.587188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ebff-9914-4fe3-9eb0-5a531915ee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:57.606401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e3e3ebff-9914-4fe3-9eb0-5a531915ee33 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:57.607639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e3e3ebff-9914-4fe3-9eb0-5a531915ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:57.616024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:37:57.654284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a389-fe94-49dc-8b7d-600db4c4c0d5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:57.665927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a389-fe94-49dc-8b7d-600db4c4c0d5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:57.669402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365db56-dc13-4165-8a49-9d8aa885d314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:57.670081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365db56-dc13-4165-8a49-9d8aa885d314 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:57.670360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365db56-dc13-4165-8a49-9d8aa885d314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:57.670635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365db56-dc13-4165-8a49-9d8aa885d314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:57.679743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365db56-dc13-4165-8a49-9d8aa885d314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:57.681166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365db56-dc13-4165-8a49-9d8aa885d314 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:57.690785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 715/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:00.064487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c404-5e41-4b8b-8603-31b5ba6464ba None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:00.065119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c404-5e41-4b8b-8603-31b5ba6464ba None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:00.065119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c404-5e41-4b8b-8603-31b5ba6464ba None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:00.066464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:00.071933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483fa3b-57b7-45d8-afbc-9b7bd4bb184e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:00.072352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483fa3b-57b7-45d8-afbc-9b7bd4bb184e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:00.072503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483fa3b-57b7-45d8-afbc-9b7bd4bb184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:00.090777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a483fa3b-57b7-45d8-afbc-9b7bd4bb184e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:00.092061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a483fa3b-57b7-45d8-afbc-9b7bd4bb184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:00.100799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:00.138834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c404-5e41-4b8b-8603-31b5ba6464ba None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:00.150145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c404-5e41-4b8b-8603-31b5ba6464ba None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:00.153737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59201a-8db8-468d-b3a1-ac551a94fbbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:00.156161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59201a-8db8-468d-b3a1-ac551a94fbbc service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:00.156161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59201a-8db8-468d-b3a1-ac551a94fbbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:00.156161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59201a-8db8-468d-b3a1-ac551a94fbbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:00.165046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59201a-8db8-468d-b3a1-ac551a94fbbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:00.166486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59201a-8db8-468d-b3a1-ac551a94fbbc service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:00.176943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 730/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:02.897193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f245f-1865-49ba-9173-019cb60730d5 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:02.897785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f245f-1865-49ba-9173-019cb60730d5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:02.897785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f245f-1865-49ba-9173-019cb60730d5 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:02.899340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:02.904649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903cde-2486-48bc-ab4b-1017b0347dc0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:02.905140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903cde-2486-48bc-ab4b-1017b0347dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:02.905243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903cde-2486-48bc-ab4b-1017b0347dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:02.922799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f5903cde-2486-48bc-ab4b-1017b0347dc0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:02.924021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f5903cde-2486-48bc-ab4b-1017b0347dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:02.932364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:02.972222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f245f-1865-49ba-9173-019cb60730d5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:02.982717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f245f-1865-49ba-9173-019cb60730d5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:02.986483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53a12d-b8f2-45b0-9d29-13986621e9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:02.987137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a12d-b8f2-45b0-9d29-13986621e9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:02.987959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a12d-b8f2-45b0-9d29-13986621e9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:02.988234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a12d-b8f2-45b0-9d29-13986621e9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:02.997129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a12d-b8f2-45b0-9d29-13986621e9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:02.998541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a12d-b8f2-45b0-9d29-13986621e9d7 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:03.009155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 718/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:05.434573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b78189-0e82-4766-ad59-519a8237f14b None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:05.435180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b78189-0e82-4766-ad59-519a8237f14b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:05.435180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b78189-0e82-4766-ad59-519a8237f14b None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:05.436551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:05.443372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c371f-b6c0-4a72-8af0-dde245a77940 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:05.443372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c371f-b6c0-4a72-8af0-dde245a77940 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:05.443974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c371f-b6c0-4a72-8af0-dde245a77940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:05.470456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-399c371f-b6c0-4a72-8af0-dde245a77940 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:05.472224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-399c371f-b6c0-4a72-8af0-dde245a77940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:05.480242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:05.521430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b78189-0e82-4766-ad59-519a8237f14b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:05.532386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b78189-0e82-4766-ad59-519a8237f14b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:05.536525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c037-0e32-4e2c-8113-718544eaae8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:05.537207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c037-0e32-4e2c-8113-718544eaae8e service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:05.537485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c037-0e32-4e2c-8113-718544eaae8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:05.537758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c037-0e32-4e2c-8113-718544eaae8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:05.548552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7c037-0e32-4e2c-8113-718544eaae8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:05.550573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7c037-0e32-4e2c-8113-718544eaae8e service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:05.561552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 733/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:07.921410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c62fef-a7f4-4ae6-b542-5afd9ae94e39 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.921989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c62fef-a7f4-4ae6-b542-5afd9ae94e39 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.921989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c62fef-a7f4-4ae6-b542-5afd9ae94e39 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.923429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:07.929503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4c73-4225-40c0-b1b8-37cbc03ae64d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.929984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4c73-4225-40c0-b1b8-37cbc03ae64d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.930088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4c73-4225-40c0-b1b8-37cbc03ae64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.947934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a0af4c73-4225-40c0-b1b8-37cbc03ae64d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:07.949142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a0af4c73-4225-40c0-b1b8-37cbc03ae64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:07.957309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:08.002374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c62fef-a7f4-4ae6-b542-5afd9ae94e39 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:08.013248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c62fef-a7f4-4ae6-b542-5afd9ae94e39 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:08.017041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafbe42-0e3e-4216-af36-cf1497ea7710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:08.017690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafbe42-0e3e-4216-af36-cf1497ea7710 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:08.017977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafbe42-0e3e-4216-af36-cf1497ea7710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:08.018256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafbe42-0e3e-4216-af36-cf1497ea7710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:08.027646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafbe42-0e3e-4216-af36-cf1497ea7710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:08.029076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafbe42-0e3e-4216-af36-cf1497ea7710 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:08.039070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 721/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:10.389260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dde57-1d65-46fc-8085-03bd799678ec None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.389849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dde57-1d65-46fc-8085-03bd799678ec None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.389849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dde57-1d65-46fc-8085-03bd799678ec None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.391192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:10.397227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fabd3-ea7f-45a8-b606-1791d4f10c8a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.397649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fabd3-ea7f-45a8-b606-1791d4f10c8a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.397796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fabd3-ea7f-45a8-b606-1791d4f10c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.416723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-719fabd3-ea7f-45a8-b606-1791d4f10c8a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:10.417968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-719fabd3-ea7f-45a8-b606-1791d4f10c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:10.426540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:10.464471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dde57-1d65-46fc-8085-03bd799678ec None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.475720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dde57-1d65-46fc-8085-03bd799678ec None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.479317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f6e7-c171-434f-b556-711e608343e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.480051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f6e7-c171-434f-b556-711e608343e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.480332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f6e7-c171-434f-b556-711e608343e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.480606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f6e7-c171-434f-b556-711e608343e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.490248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31f6e7-c171-434f-b556-711e608343e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.491687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31f6e7-c171-434f-b556-711e608343e9 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.501194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 736/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:12.804135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6889-463c-4ab3-8d40-a493d52ea50f None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.805008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6889-463c-4ab3-8d40-a493d52ea50f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.805199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6889-463c-4ab3-8d40-a493d52ea50f None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.807431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:12.813221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd64c9-c68f-452f-ae93-68d825e26730 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.813749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd64c9-c68f-452f-ae93-68d825e26730 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.813875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd64c9-c68f-452f-ae93-68d825e26730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.820941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=70 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:12.833366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9bcd64c9-c68f-452f-ae93-68d825e26730 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:12.839836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9bcd64c9-c68f-452f-ae93-68d825e26730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:12.842490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:12.880980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6889-463c-4ab3-8d40-a493d52ea50f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.886887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=73 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:12.895243 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6889-463c-4ab3-8d40-a493d52ea50f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.898918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cbf2d-c801-4f40-9548-574c63ce6f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.899605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cbf2d-c801-4f40-9548-574c63ce6f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.899893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cbf2d-c801-4f40-9548-574c63ce6f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.900169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cbf2d-c801-4f40-9548-574c63ce6f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.910936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cbf2d-c801-4f40-9548-574c63ce6f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.912455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cbf2d-c801-4f40-9548-574c63ce6f05 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.922925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 724/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:38:15.212508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf564-ed2d-4247-a345-3b2550514398 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.213042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf564-ed2d-4247-a345-3b2550514398 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.213042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf564-ed2d-4247-a345-3b2550514398 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.214404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:15.225965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f380b-219f-4fce-bb60-0ea2cc035964 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.226602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f380b-219f-4fce-bb60-0ea2cc035964 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.226602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f380b-219f-4fce-bb60-0ea2cc035964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.245339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f75f380b-219f-4fce-bb60-0ea2cc035964 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:15.246562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f75f380b-219f-4fce-bb60-0ea2cc035964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:15.255158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:15.292968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf564-ed2d-4247-a345-3b2550514398 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.304221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf564-ed2d-4247-a345-3b2550514398 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.308663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9413a-b379-4718-8d5e-d0281c3c8502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.309748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9413a-b379-4718-8d5e-d0281c3c8502 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.310251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9413a-b379-4718-8d5e-d0281c3c8502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.310753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9413a-b379-4718-8d5e-d0281c3c8502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.321887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9413a-b379-4718-8d5e-d0281c3c8502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.323403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9413a-b379-4718-8d5e-d0281c3c8502 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.334334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 739/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:38:17.576605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e41c-e3e1-4b71-b0f6-18c4421a13f0 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:17.577177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e41c-e3e1-4b71-b0f6-18c4421a13f0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:17.577328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e41c-e3e1-4b71-b0f6-18c4421a13f0 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:17.578591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:17.584389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff054922-83dc-4460-9d05-da17c76e01bf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:17.584857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff054922-83dc-4460-9d05-da17c76e01bf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:17.584962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff054922-83dc-4460-9d05-da17c76e01bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:17.602994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ff054922-83dc-4460-9d05-da17c76e01bf None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:17.604239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ff054922-83dc-4460-9d05-da17c76e01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:17.613246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:17.649158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e41c-e3e1-4b71-b0f6-18c4421a13f0 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:17.660713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e41c-e3e1-4b71-b0f6-18c4421a13f0 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:17.664354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6daa89-d2ac-42aa-a330-a631a5bd82f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:17.665001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6daa89-d2ac-42aa-a330-a631a5bd82f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:17.665289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6daa89-d2ac-42aa-a330-a631a5bd82f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:17.665569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6daa89-d2ac-42aa-a330-a631a5bd82f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:17.675614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6daa89-d2ac-42aa-a330-a631a5bd82f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:17.677044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6daa89-d2ac-42aa-a330-a631a5bd82f6 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:17.686862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 727/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:19.962037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255c1-9151-4e80-99b6-1574d9f3a995 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.962622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255c1-9151-4e80-99b6-1574d9f3a995 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.962622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255c1-9151-4e80-99b6-1574d9f3a995 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.963989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:19.969671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429e0b-5335-49e3-b4d0-d0e1a34da5b0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.970188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429e0b-5335-49e3-b4d0-d0e1a34da5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.970295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429e0b-5335-49e3-b4d0-d0e1a34da5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.989309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b8429e0b-5335-49e3-b4d0-d0e1a34da5b0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:19.990517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b8429e0b-5335-49e3-b4d0-d0e1a34da5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:19.998370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:20.034960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666255c1-9151-4e80-99b6-1574d9f3a995 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.045746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666255c1-9151-4e80-99b6-1574d9f3a995 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.049286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece63447-f8e1-4005-a280-d8281468fbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.049936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece63447-f8e1-4005-a280-d8281468fbfe service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.050214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece63447-f8e1-4005-a280-d8281468fbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.050490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece63447-f8e1-4005-a280-d8281468fbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.061372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece63447-f8e1-4005-a280-d8281468fbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.062175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece63447-f8e1-4005-a280-d8281468fbfe service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.073159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 742/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:29.983038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=17 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:30.068572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=17 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:54.300878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1e17-e831-4223-aed1-7eccbcb175c0 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.301532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1e17-e831-4223-aed1-7eccbcb175c0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.301532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f1e17-e831-4223-aed1-7eccbcb175c0 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.302963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 729/1471] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:38:54.308748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f14c-b1c3-4d9b-a5b0-bc4d8637bee3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.309550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f14c-b1c3-4d9b-a5b0-bc4d8637bee3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.309777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f14c-b1c3-4d9b-a5b0-bc4d8637bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.327816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4ef8f14c-b1c3-4d9b-a5b0-bc4d8637bee3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:54.329045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4ef8f14c-b1c3-4d9b-a5b0-bc4d8637bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.337284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 743/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:54.386042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334abe1-dd40-43db-a33e-3759b799dea0 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.386335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334abe1-dd40-43db-a33e-3759b799dea0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.386627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334abe1-dd40-43db-a33e-3759b799dea0 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.388093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 730/1473] 10.222.0.32 () {54 vars in 962 bytes} [Mon May 23 15:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:54.393225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e1c8-2a9a-48d4-b3f9-81567df3e563 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.393519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e1c8-2a9a-48d4-b3f9-81567df3e563 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.393801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e1c8-2a9a-48d4-b3f9-81567df3e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.413579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ce02e1c8-2a9a-48d4-b3f9-81567df3e563 None None] MFA Rules not processed for user `43d6df3eff264a17a0b970c7fa9eef65`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:54.414805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce02e1c8-2a9a-48d4-b3f9-81567df3e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.421753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 744/1474] 10.222.0.32 () {58 vars in 1059 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:54.429820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334abe1-dd40-43db-a33e-3759b799dea0 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.441038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334abe1-dd40-43db-a33e-3759b799dea0 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.444774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32123c48-937a-4dbc-bf33-04c203e75427 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.445431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32123c48-937a-4dbc-bf33-04c203e75427 service glance] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.445715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32123c48-937a-4dbc-bf33-04c203e75427 service glance] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.445994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32123c48-937a-4dbc-bf33-04c203e75427 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.455915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32123c48-937a-4dbc-bf33-04c203e75427 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.457365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32123c48-937a-4dbc-bf33-04c203e75427 service glance] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.468146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 731/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:56.800985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb6aca-79b9-4568-a683-2a9a15d144db None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:56.801572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb6aca-79b9-4568-a683-2a9a15d144db None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:56.801572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb6aca-79b9-4568-a683-2a9a15d144db None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:56.802942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 745/1476] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:56.808574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c5ffc-2faa-48a5-b789-d004e8659ae9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:56.808997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c5ffc-2faa-48a5-b789-d004e8659ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:56.809132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c5ffc-2faa-48a5-b789-d004e8659ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:56.956828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-837c5ffc-2faa-48a5-b789-d004e8659ae9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:56.958063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-837c5ffc-2faa-48a5-b789-d004e8659ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:56.966318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 732/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:56.990417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb6aca-79b9-4568-a683-2a9a15d144db None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:57.004173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb6aca-79b9-4568-a683-2a9a15d144db None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:57.008571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:57.009223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:57.009508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:57.009786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:57.010528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:57.012355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:38:57.012355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:38:57.012355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:38:57.013536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dae70-69a4-4415-a513-61efd97f6cd7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:57.033957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 746/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 23 15:38:56 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:59.427644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7009d-02ab-46c7-9ee0-6ab12027b391 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:59.428322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7009d-02ab-46c7-9ee0-6ab12027b391 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:59.428322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7009d-02ab-46c7-9ee0-6ab12027b391 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:59.429579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 733/1479] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:59.435075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c31c4-d12d-42b7-b67c-fb77da90b9b1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:59.435554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c31c4-d12d-42b7-b67c-fb77da90b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:59.435687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c31c4-d12d-42b7-b67c-fb77da90b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:59.454420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5b0c31c4-d12d-42b7-b67c-fb77da90b9b1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:59.456226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b0c31c4-d12d-42b7-b67c-fb77da90b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:59.464203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 747/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:59.508473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7009d-02ab-46c7-9ee0-6ab12027b391 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:59.524230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7009d-02ab-46c7-9ee0-6ab12027b391 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:59.529740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc388d-c9ef-4c8a-8cce-d4e54d1fc687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:59.530396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc388d-c9ef-4c8a-8cce-d4e54d1fc687 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:59.530681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc388d-c9ef-4c8a-8cce-d4e54d1fc687 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:59.530960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc388d-c9ef-4c8a-8cce-d4e54d1fc687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:59.539978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc388d-c9ef-4c8a-8cce-d4e54d1fc687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:59.541554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc388d-c9ef-4c8a-8cce-d4e54d1fc687 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:59.551849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 734/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:01.970897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f660-71e0-4f83-a2ea-a126d9209391 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:01.971728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f660-71e0-4f83-a2ea-a126d9209391 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:01.971728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f660-71e0-4f83-a2ea-a126d9209391 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:01.972872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 748/1482] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:01.978626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691c3a-60a3-4f27-b82a-8a2693f590dc None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:01.979146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691c3a-60a3-4f27-b82a-8a2693f590dc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:01.979278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691c3a-60a3-4f27-b82a-8a2693f590dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:01.997765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-db691c3a-60a3-4f27-b82a-8a2693f590dc None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:01.999229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-db691c3a-60a3-4f27-b82a-8a2693f590dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:02.007252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 735/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:39:02.043339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273f660-71e0-4f83-a2ea-a126d9209391 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:02.054488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273f660-71e0-4f83-a2ea-a126d9209391 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:02.058141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7603d1-5299-410a-926e-2caf678d3d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:02.058772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7603d1-5299-410a-926e-2caf678d3d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:02.059055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7603d1-5299-410a-926e-2caf678d3d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:02.059368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7603d1-5299-410a-926e-2caf678d3d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:02.068697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7603d1-5299-410a-926e-2caf678d3d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:02.070148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7603d1-5299-410a-926e-2caf678d3d4d service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:02.081364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 749/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:04.347729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a57cc-56df-4ccb-9732-594b6fec5a13 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:04.348318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a57cc-56df-4ccb-9732-594b6fec5a13 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:04.348318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a57cc-56df-4ccb-9732-594b6fec5a13 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:04.349808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 736/1485] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:04.354962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679f38-fd06-460c-9dc4-5e9a9ccd9703 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:04.355411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679f38-fd06-460c-9dc4-5e9a9ccd9703 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:04.355556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679f38-fd06-460c-9dc4-5e9a9ccd9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:04.373813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-54679f38-fd06-460c-9dc4-5e9a9ccd9703 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:04.375015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-54679f38-fd06-460c-9dc4-5e9a9ccd9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:04.383728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 750/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:04.420219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a57cc-56df-4ccb-9732-594b6fec5a13 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:04.435290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a57cc-56df-4ccb-9732-594b6fec5a13 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:04.439729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b4bb7-c162-4656-ae8b-46ce6c34b629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:04.440273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b4bb7-c162-4656-ae8b-46ce6c34b629 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:04.440554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b4bb7-c162-4656-ae8b-46ce6c34b629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:04.440834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b4bb7-c162-4656-ae8b-46ce6c34b629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:04.452847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b4bb7-c162-4656-ae8b-46ce6c34b629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:04.454271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b4bb7-c162-4656-ae8b-46ce6c34b629 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:04.464179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 737/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:06.925624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1543de-999a-4158-ae73-4795a79bac8e None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:06.926044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1543de-999a-4158-ae73-4795a79bac8e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:06.926279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1543de-999a-4158-ae73-4795a79bac8e None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:06.927812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 751/1488] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:06.933765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d02ce-1b6a-45fd-a91e-1baf62d64eee None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:06.934227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d02ce-1b6a-45fd-a91e-1baf62d64eee None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:06.934659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d02ce-1b6a-45fd-a91e-1baf62d64eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:06.954301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bb6d02ce-1b6a-45fd-a91e-1baf62d64eee None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:06.956099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bb6d02ce-1b6a-45fd-a91e-1baf62d64eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:06.964298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 738/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:07.004167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1543de-999a-4158-ae73-4795a79bac8e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:07.015033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1543de-999a-4158-ae73-4795a79bac8e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:07.019288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40479f-61ec-47d6-afec-b0bc89381ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:07.019931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40479f-61ec-47d6-afec-b0bc89381ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:07.020218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40479f-61ec-47d6-afec-b0bc89381ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:07.020498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40479f-61ec-47d6-afec-b0bc89381ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:07.029754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40479f-61ec-47d6-afec-b0bc89381ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:07.031262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40479f-61ec-47d6-afec-b0bc89381ecd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:07.041578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 752/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:09.753381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b6a0-fe76-4bea-acfe-c19c19b5ee38 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:09.753968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b6a0-fe76-4bea-acfe-c19c19b5ee38 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:09.753968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b6a0-fe76-4bea-acfe-c19c19b5ee38 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:09.755403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 739/1491] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 23 15:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:09.760759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761da28-5c35-44b0-b1f2-3216f7c2e848 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:09.761192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761da28-5c35-44b0-b1f2-3216f7c2e848 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:09.761357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761da28-5c35-44b0-b1f2-3216f7c2e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:09.779718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2761da28-5c35-44b0-b1f2-3216f7c2e848 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:09.780918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2761da28-5c35-44b0-b1f2-3216f7c2e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:09.789318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 753/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 23 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:09.827175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b6a0-fe76-4bea-acfe-c19c19b5ee38 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:09.838587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b6a0-fe76-4bea-acfe-c19c19b5ee38 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:09.842093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3462-4090-4f73-b212-6262e2bf77aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:09.842732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3462-4090-4f73-b212-6262e2bf77aa service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:09.843018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3462-4090-4f73-b212-6262e2bf77aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:09.843331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3462-4090-4f73-b212-6262e2bf77aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:09.853068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3462-4090-4f73-b212-6262e2bf77aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:09.854448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3462-4090-4f73-b212-6262e2bf77aa service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:09.865439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 740/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:19.774498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=33 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:19.860155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=33 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:03.301946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.302546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.302546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.321565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:03.322764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:03.330976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 754/1494] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:03.340690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.341224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.341224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.359493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:03.360687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:03.369406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 741/1495] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:03.374368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:03.384780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848574d-1b72-4eed-98ee-7d452033fd82 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:03.389307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:03.389964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.390247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.390529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.391301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:41:03.391608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:03.392628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:03.392628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:41:03.392628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:41:03.393620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:03.405472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 755/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:41:03.414236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:03.423724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366f58-d1af-47bb-bf41-04e39575c9e1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:03.428838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:03.429510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.429794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.430073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.430770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:03.432586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:03.432586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:41:03.432586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:41:03.433774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:03.571485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 742/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:41:03 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:41:03.576234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:03.586596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e784-9cd2-4eb1-a14b-cfb6c0c54ade admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:03.645244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:03.645922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.646205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.646479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.647429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:03.648545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:03.648545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:41:03.648545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:41:03.649803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:03.749437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 756/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:41:03 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:41:03.753851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:03.764292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087d4f-eec3-4047-8f47-0440e78fed28 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:03.768782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:03.769450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.769732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.770009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.770744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:03.771789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:03.771789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:41:03.771789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:41:03.772668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:03.786317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 743/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:41:03.790419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:03.800652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43d2c-d925-489e-9347-960d21814455 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:03.805803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:03.806456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.806739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.807015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.807778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:03.808781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:03.808781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:41:03.808781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:41:03.809677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9c5e-847e-4a23-a46b-f18b6c2385ed admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:03.824157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 757/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:41:03.828360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:03.838448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82a55-de3b-4ee0-8b4a-0fc2d0f4303c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:03.842939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:03.843852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:03.844135 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:03.844410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] PATH_INFO: `/v3/projects/474593c237e544d5b05273e9ab8bf57c/users/2cad7eb98c7245618d4b0d64d4982df2/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:03.859485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=474593c237e544d5b05273e9ab8bf57c, user_id=2cad7eb98c7245618d4b0d64d4982df2, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:03.860504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:03.860504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:41:03.860504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:41:03.862427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595231d0-6846-465f-a3c3-a06e4cd0b87d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:04.073286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 744/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:41:03 2022] PUT /identity/v3/projects/474593c237e544d5b05273e9ab8bf57c/users/2cad7eb98c7245618d4b0d64d4982df2/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:04.085261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57997-33b3-4fdd-8002-8c66ba0f4281 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:04.085499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57997-33b3-4fdd-8002-8c66ba0f4281 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:04.085780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57997-33b3-4fdd-8002-8c66ba0f4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:04.112395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d3c57997-33b3-4fdd-8002-8c66ba0f4281 None None] MFA Rules not processed for user `2cad7eb98c7245618d4b0d64d4982df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:04.113613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d3c57997-33b3-4fdd-8002-8c66ba0f4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:04.178677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 758/1502] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:04.195600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f06bd0-1eec-4533-9880-3c10407113d9 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:04.195897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f06bd0-1eec-4533-9880-3c10407113d9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:04.196182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f06bd0-1eec-4533-9880-3c10407113d9 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:04.197607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 745/1503] 10.222.0.32 () {54 vars in 963 bytes} [Mon May 23 15:41:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:41:04.202958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6be4-7482-4664-bb0d-b39c1582d4fa None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:04.203446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6be4-7482-4664-bb0d-b39c1582d4fa None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:04.203590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6be4-7482-4664-bb0d-b39c1582d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:04.222339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d28e6be4-7482-4664-bb0d-b39c1582d4fa None None] MFA Rules not processed for user `2edb5d30e76d488491a9d7c38b3300f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:04.224150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d28e6be4-7482-4664-bb0d-b39c1582d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:04.271372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:04.278658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 759/1504] 10.222.0.32 () {58 vars in 1060 bytes} [Mon May 23 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:04.287066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f06bd0-1eec-4533-9880-3c10407113d9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:04.298546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f06bd0-1eec-4533-9880-3c10407113d9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:04.302105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:04.302746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:04.303195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:04.303478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:04.311913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:04.313358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:04.322961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 746/1505] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:04.367891 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c043-9b05-4650-8f1c-437c86ab9ba4 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:04.368309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c043-9b05-4650-8f1c-437c86ab9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:04.368457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c043-9b05-4650-8f1c-437c86ab9ba4 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:04.369751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 760/1506] 10.222.0.32 () {52 vars in 829 bytes} [Mon May 23 15:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:41:04.373426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:04.435165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034c268-3320-4ebf-8ccd-6556d629cabf service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:04.439627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:04.440504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:04.440789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:04.441065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] PATH_INFO: `/v3/users/2cad7eb98c7245618d4b0d64d4982df2` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:04.442813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cad7eb98c7245618d4b0d64d4982df2)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:04.443851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:04.443851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:41:04.443851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:41:04.445053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:04.818260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cad7eb98c7245618d4b0d64d4982df2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:05.039888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cad7eb98c7245618d4b0d64d4982df2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:05.040530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cad7eb98c7245618d4b0d64d4982df2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:05.062288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cad7eb98c7245618d4b0d64d4982df2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:05.077325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:05.077325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cad7eb98c7245618d4b0d64d4982df2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:05.086477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 747/1507] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:41:04 2022] DELETE /identity/v3/users/2cad7eb98c7245618d4b0d64d4982df2 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:05.093656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:05.094154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:05.094635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:05.125021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:05.127026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:05.216624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 761/1508] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:05.226741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:05.228615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:05.294397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd727-05d2-4be4-9cce-4762289253af admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:05.306087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067da4f-8302-4050-aaa4-701285940022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:05.306087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067da4f-8302-4050-aaa4-701285940022 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:05.306087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067da4f-8302-4050-aaa4-701285940022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:05.306087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067da4f-8302-4050-aaa4-701285940022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:05.309620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067da4f-8302-4050-aaa4-701285940022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:05.311157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067da4f-8302-4050-aaa4-701285940022 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:05.321290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 748/1509] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:05.891754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:05.893332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:05.906032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b7916-ba26-4fd4-98fd-df665c24015b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:05.911207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:05.912264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:05.912588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:05.912904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] PATH_INFO: `/v3/projects/474593c237e544d5b05273e9ab8bf57c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:05.914208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474593c237e544d5b05273e9ab8bf57c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:05.915157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:41:05.915157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:41:05.915157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:41:05.916386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:06.063482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474593c237e544d5b05273e9ab8bf57c', 'request_id': 'req-428156ce-affd-4d2e-8c6f-2d1496612807'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:06.142804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474593c237e544d5b05273e9ab8bf57c', 'request_id': 'req-428156ce-affd-4d2e-8c6f-2d1496612807'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:06.157856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474593c237e544d5b05273e9ab8bf57c', 'request_id': 'req-428156ce-affd-4d2e-8c6f-2d1496612807'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:06.169542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] The token cache is being invalidate because project 474593c237e544d5b05273e9ab8bf57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:41:06.169833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:06.170609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-428156ce-affd-4d2e-8c6f-2d1496612807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:06.172290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 762/1510] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:41:05 2022] DELETE /identity/v3/projects/474593c237e544d5b05273e9ab8bf57c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:15.530979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=29 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:16.166404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:48.586045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709dc2-cae4-48d1-9b14-4ccb8dc140b5 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:48.586638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709dc2-cae4-48d1-9b14-4ccb8dc140b5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:48.586638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709dc2-cae4-48d1-9b14-4ccb8dc140b5 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:48.587959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:42:48.592696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff783-6f37-4079-b265-c1b7f84fe653 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:48.593194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff783-6f37-4079-b265-c1b7f84fe653 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:48.593337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff783-6f37-4079-b265-c1b7f84fe653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:48.611241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d81ff783-6f37-4079-b265-c1b7f84fe653 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:48.620864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d81ff783-6f37-4079-b265-c1b7f84fe653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:48.673959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:48.847958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709dc2-cae4-48d1-9b14-4ccb8dc140b5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:48.850547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a0709dc2-cae4-48d1-9b14-4ccb8dc140b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:48.932349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709dc2-cae4-48d1-9b14-4ccb8dc140b5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:48.937781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17901d8-26a8-4cb6-b5a6-f1cecb042dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:48.938433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17901d8-26a8-4cb6-b5a6-f1cecb042dfe service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:48.938715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17901d8-26a8-4cb6-b5a6-f1cecb042dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:48.938993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17901d8-26a8-4cb6-b5a6-f1cecb042dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:48.947614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17901d8-26a8-4cb6-b5a6-f1cecb042dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:48.949204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17901d8-26a8-4cb6-b5a6-f1cecb042dfe service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:48.959296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 750/1513] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:49.840165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5fe0-122e-4244-a4c3-9271cbd268d7 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:49.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5fe0-122e-4244-a4c3-9271cbd268d7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:49.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5fe0-122e-4244-a4c3-9271cbd268d7 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:49.842125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:42:49.847806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bb2a4-81c5-4c77-bb42-916beba7c31c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:49.848294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bb2a4-81c5-4c77-bb42-916beba7c31c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:49.848797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bb2a4-81c5-4c77-bb42-916beba7c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:49.868570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-957bb2a4-81c5-4c77-bb42-916beba7c31c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:49.869768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-957bb2a4-81c5-4c77-bb42-916beba7c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:49.877624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:50.033547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b5fe0-122e-4244-a4c3-9271cbd268d7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:50.051824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b5fe0-122e-4244-a4c3-9271cbd268d7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:50.056361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88294164-0ffa-4e80-9e2f-b3d2187d4715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:50.057025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294164-0ffa-4e80-9e2f-b3d2187d4715 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:50.057307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294164-0ffa-4e80-9e2f-b3d2187d4715 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:50.057584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294164-0ffa-4e80-9e2f-b3d2187d4715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:50.066900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294164-0ffa-4e80-9e2f-b3d2187d4715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:50.068533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294164-0ffa-4e80-9e2f-b3d2187d4715 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:50.078124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 765/1516] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:50.099556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25854ea-10f1-4a19-ac5a-56eb5b4ba0eb None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:50.099556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25854ea-10f1-4a19-ac5a-56eb5b4ba0eb None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:50.099556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25854ea-10f1-4a19-ac5a-56eb5b4ba0eb None None] PATH_INFO: `/v3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:50.099556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 752/1517] 10.222.0.62 () {54 vars in 925 bytes} [Mon May 23 15:42:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:42:50.104989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ec8e4-7370-4364-bd16-2c0385416611 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:50.105278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ec8e4-7370-4364-bd16-2c0385416611 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:50.105558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ec8e4-7370-4364-bd16-2c0385416611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:50.125258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ad9ec8e4-7370-4364-bd16-2c0385416611 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:50.126533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ad9ec8e4-7370-4364-bd16-2c0385416611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:50.196765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 766/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Mon May 23 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:59.493442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c52f1-895e-4a2b-a0d0-20504ffd242f None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:59.493988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c52f1-895e-4a2b-a0d0-20504ffd242f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:59.493988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c52f1-895e-4a2b-a0d0-20504ffd242f None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:59.495450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 753/1519] 10.222.0.32 () {54 vars in 960 bytes} [Mon May 23 15:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:42:59.500270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12be0-70bb-4480-bcc1-a36e47f16c08 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:59.500745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12be0-70bb-4480-bcc1-a36e47f16c08 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:59.500855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12be0-70bb-4480-bcc1-a36e47f16c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:59.521349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-51d12be0-70bb-4480-bcc1-a36e47f16c08 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:59.522547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51d12be0-70bb-4480-bcc1-a36e47f16c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:59.532208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 767/1520] 10.222.0.32 () {58 vars in 1057 bytes} [Mon May 23 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:59.540209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c52f1-895e-4a2b-a0d0-20504ffd242f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:59.553517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c52f1-895e-4a2b-a0d0-20504ffd242f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:59.558428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616699-fc58-429e-b418-140cc387fc4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:59.559064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616699-fc58-429e-b418-140cc387fc4d service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:59.559450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616699-fc58-429e-b418-140cc387fc4d service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:59.559728 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616699-fc58-429e-b418-140cc387fc4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:59.568559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616699-fc58-429e-b418-140cc387fc4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:59.570223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616699-fc58-429e-b418-140cc387fc4d service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:59.580011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 754/1521] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:42:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:01.376600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82cad-8aae-415d-993c-51283a7d5eba None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:01.377163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82cad-8aae-415d-993c-51283a7d5eba None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:01.377163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82cad-8aae-415d-993c-51283a7d5eba None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:01.378526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:43:01.384297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1fb12-9fa7-4106-a3b1-98956949554c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:01.384752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1fb12-9fa7-4106-a3b1-98956949554c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:01.384913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1fb12-9fa7-4106-a3b1-98956949554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:01.403903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-10f1fb12-9fa7-4106-a3b1-98956949554c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:43:01.405092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-10f1fb12-9fa7-4106-a3b1-98956949554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:01.412848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:43:01.566878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82cad-8aae-415d-993c-51283a7d5eba None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:43:01.582190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82cad-8aae-415d-993c-51283a7d5eba None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:43:01.588145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268ab5a-65d2-4009-870b-dd4edaaf8b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:43:01.588807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268ab5a-65d2-4009-870b-dd4edaaf8b49 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:01.589093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268ab5a-65d2-4009-870b-dd4edaaf8b49 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:01.589373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268ab5a-65d2-4009-870b-dd4edaaf8b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:01.597797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268ab5a-65d2-4009-870b-dd4edaaf8b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:43:01.599428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268ab5a-65d2-4009-870b-dd4edaaf8b49 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:43:01.609465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 769/1524] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:02.476982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568a4c-8299-46e2-9432-6439446c6e10 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:02.477544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568a4c-8299-46e2-9432-6439446c6e10 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:02.477544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568a4c-8299-46e2-9432-6439446c6e10 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:02.478951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:43:02.483792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7a5a-ee53-45c7-a09d-413f042a99a1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:02.484247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7a5a-ee53-45c7-a09d-413f042a99a1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:02.484352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7a5a-ee53-45c7-a09d-413f042a99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:02.503042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-73fc7a5a-ee53-45c7-a09d-413f042a99a1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:43:02.504265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73fc7a5a-ee53-45c7-a09d-413f042a99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:02.517036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:43:02.667856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568a4c-8299-46e2-9432-6439446c6e10 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:43:02.682326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568a4c-8299-46e2-9432-6439446c6e10 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:43:02.687564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47e0a4-93cc-469f-b821-655f0fec6183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:43:02.688195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47e0a4-93cc-469f-b821-655f0fec6183 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:02.688475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47e0a4-93cc-469f-b821-655f0fec6183 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:02.688747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47e0a4-93cc-469f-b821-655f0fec6183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:02.696732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47e0a4-93cc-469f-b821-655f0fec6183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:43:02.698282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47e0a4-93cc-469f-b821-655f0fec6183 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:43:02.707583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 757/1527] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:06.957098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ab5a-c369-4573-8bce-60849262f3b6 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:06.957672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ab5a-c369-4573-8bce-60849262f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:06.957672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ab5a-c369-4573-8bce-60849262f3b6 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:06.959052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:43:06.966499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc3cbb-0cf6-409f-99c0-6141936d6e19 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:06.967184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc3cbb-0cf6-409f-99c0-6141936d6e19 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:06.967531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc3cbb-0cf6-409f-99c0-6141936d6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:06.989395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b9dc3cbb-0cf6-409f-99c0-6141936d6e19 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:43:06.990591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b9dc3cbb-0cf6-409f-99c0-6141936d6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:06.999560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:43:07.036156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ab5a-c369-4573-8bce-60849262f3b6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:43:07.037980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1cb3ab5a-c369-4573-8bce-60849262f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:07.097238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ab5a-c369-4573-8bce-60849262f3b6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:43:07.100839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2ecf-1025-4c79-8156-ec5d7bd07030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:43:07.101491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2ecf-1025-4c79-8156-ec5d7bd07030 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:07.101867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2ecf-1025-4c79-8156-ec5d7bd07030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:07.102155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2ecf-1025-4c79-8156-ec5d7bd07030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:07.111391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2ecf-1025-4c79-8156-ec5d7bd07030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:43:07.112875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2ecf-1025-4c79-8156-ec5d7bd07030 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:43:07.119245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:07.124121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 772/1530] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:09.376398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310c543-fa72-433e-87ff-1032700213af None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:09.376914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310c543-fa72-433e-87ff-1032700213af None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:09.376914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310c543-fa72-433e-87ff-1032700213af None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:09.378283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:43:09.383763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccde04-1bb4-4875-85a3-df39c365ca30 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:09.384189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccde04-1bb4-4875-85a3-df39c365ca30 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:09.384336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccde04-1bb4-4875-85a3-df39c365ca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:09.402895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-65ccde04-1bb4-4875-85a3-df39c365ca30 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:43:09.404137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-65ccde04-1bb4-4875-85a3-df39c365ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:09.411995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:43:09.448865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310c543-fa72-433e-87ff-1032700213af None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:43:09.450579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4310c543-fa72-433e-87ff-1032700213af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:09.463954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310c543-fa72-433e-87ff-1032700213af None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:43:09.467387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974123d5-c6df-4a06-beda-f9f2e2e6ded7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:43:09.468025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974123d5-c6df-4a06-beda-f9f2e2e6ded7 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:09.468307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974123d5-c6df-4a06-beda-f9f2e2e6ded7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:09.468584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974123d5-c6df-4a06-beda-f9f2e2e6ded7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:09.477799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974123d5-c6df-4a06-beda-f9f2e2e6ded7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:43:09.479491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974123d5-c6df-4a06-beda-f9f2e2e6ded7 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:43:09.489292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 760/1533] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:13.323152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399d01-914c-4279-86c6-decbb7b97ba0 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:13.323714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399d01-914c-4279-86c6-decbb7b97ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:13.323714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399d01-914c-4279-86c6-decbb7b97ba0 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:13.325076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:43:13.330508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658664-e08c-4baa-944d-c4ce05fa8d18 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:13.330940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658664-e08c-4baa-944d-c4ce05fa8d18 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:13.331077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658664-e08c-4baa-944d-c4ce05fa8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:13.348847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-28658664-e08c-4baa-944d-c4ce05fa8d18 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:43:13.350041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-28658664-e08c-4baa-944d-c4ce05fa8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:13.358157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:43:13.634664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399d01-914c-4279-86c6-decbb7b97ba0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:43:13.636375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4b399d01-914c-4279-86c6-decbb7b97ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:13.695010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399d01-914c-4279-86c6-decbb7b97ba0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:43:13.698629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffe610-f415-4138-9861-f2978237d1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:43:13.699313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe610-f415-4138-9861-f2978237d1fa service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:13.699602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe610-f415-4138-9861-f2978237d1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:13.699885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe610-f415-4138-9861-f2978237d1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:13.708879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffe610-f415-4138-9861-f2978237d1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:43:13.710320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffe610-f415-4138-9861-f2978237d1fa service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:43:13.720541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 775/1536] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:15.954832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53e8d-e578-4380-8ba2-24fa4f0b112f None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:15.955484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53e8d-e578-4380-8ba2-24fa4f0b112f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:15.955484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53e8d-e578-4380-8ba2-24fa4f0b112f None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:15.956806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:43:15.962085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6335a-53a4-4497-956a-06b892cd3716 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:15.962511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6335a-53a4-4497-956a-06b892cd3716 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:15.962638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6335a-53a4-4497-956a-06b892cd3716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:15.980544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-00c6335a-53a4-4497-956a-06b892cd3716 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:43:15.981760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-00c6335a-53a4-4497-956a-06b892cd3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:15.989869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:43:16.262753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad53e8d-e578-4380-8ba2-24fa4f0b112f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:43:16.264440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-3ad53e8d-e578-4380-8ba2-24fa4f0b112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:43:16.272009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=65 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:16.277985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad53e8d-e578-4380-8ba2-24fa4f0b112f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:43:16.281678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309834a-dcda-4f26-918e-085b807fb42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:43:16.292601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309834a-dcda-4f26-918e-085b807fb42b service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:43:16.292601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309834a-dcda-4f26-918e-085b807fb42b service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:43:16.292601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309834a-dcda-4f26-918e-085b807fb42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:43:16.292601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309834a-dcda-4f26-918e-085b807fb42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:43:16.293549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309834a-dcda-4f26-918e-085b807fb42b service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:43:16.302868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 763/1539] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:25.975201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=32 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:26.318143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:48.445413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.446033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.446033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.472707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:48.473927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:48.486979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 777/1540] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:48.497985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.498555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.498555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.528542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:48.529803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:48.544894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 764/1541] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:48.552308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:48.564770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b5eb-7b45-41a8-b0a1-0fbab0d4b026 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:48.576234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:48.576947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.577229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.577507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.578269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:48.578579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:48.580307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd5cb9-ffaf-4aca-88fb-744e804a9729 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:48.599241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 778/1542] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:48.605400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:48.622008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e560-7f4a-46c2-80c5-d3d5ea9a0e36 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:48.637675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2a1f5-bae0-41c8-911e-037fff138f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:48.638366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2a1f5-bae0-41c8-911e-037fff138f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.638655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2a1f5-bae0-41c8-911e-037fff138f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.638935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2a1f5-bae0-41c8-911e-037fff138f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.639834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2a1f5-bae0-41c8-911e-037fff138f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:48.641763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2a1f5-bae0-41c8-911e-037fff138f1b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:48.647007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c9ff-51e0-4288-9849-9aa5822591eb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.647007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c9ff-51e0-4288-9849-9aa5822591eb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.647007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c9ff-51e0-4288-9849-9aa5822591eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.700373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6d20c9ff-51e0-4288-9849-9aa5822591eb None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:48.701639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6d20c9ff-51e0-4288-9849-9aa5822591eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:48.716903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 779/1543] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:44:48.726651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.726936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.727243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.753035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:48.754260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:48.769538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 780/1544] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:44:48.773871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:48.784171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484e8c-a351-4946-897c-fb8e081b2e79 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:48.793363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:48.794065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.795520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.795804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.796582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:48.796894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:48.798595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:48.805222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 765/1545] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:48.807080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.807405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.807689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.839122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 781/1546] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:48.839122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:48.846775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:48.848032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:48.856790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373dcb-253c-496b-b9ea-e2812bca691c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:48.965066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473f9f9-9443-416a-8246-9327ac0f9b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:48.965760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f9f9-9443-416a-8246-9327ac0f9b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.966045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f9f9-9443-416a-8246-9327ac0f9b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.966322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f9f9-9443-416a-8246-9327ac0f9b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.967064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473f9f9-9443-416a-8246-9327ac0f9b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:48.969070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473f9f9-9443-416a-8246-9327ac0f9b77 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:48.970486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 766/1547] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:44:48.971714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:48.991199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662b67-fa8f-48f7-8c89-abb7b63c8aa2 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:48.996465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6915c6-6bf8-4df6-b6cb-39ad328faf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:48.997194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6915c6-6bf8-4df6-b6cb-39ad328faf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:48.997521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6915c6-6bf8-4df6-b6cb-39ad328faf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:48.997804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6915c6-6bf8-4df6-b6cb-39ad328faf6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:48.998509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6915c6-6bf8-4df6-b6cb-39ad328faf6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.000458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6915c6-6bf8-4df6-b6cb-39ad328faf6c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.073624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 782/1548] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:49.080282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2cf52-2782-4d00-884f-b8c921bdd45f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.080282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2cf52-2782-4d00-884f-b8c921bdd45f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.080282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2cf52-2782-4d00-884f-b8c921bdd45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.093382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4ef2cf52-2782-4d00-884f-b8c921bdd45f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.094631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4ef2cf52-2782-4d00-884f-b8c921bdd45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.102887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 783/1549] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.104175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4fd5-cd33-45fd-a906-b696b39dcd02 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.104482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4fd5-cd33-45fd-a906-b696b39dcd02 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.104747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4fd5-cd33-45fd-a906-b696b39dcd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.120040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 767/1550] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:48 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:49.121438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52f84-3c1c-4f8f-88b9-697f6c3d8639 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.121731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52f84-3c1c-4f8f-88b9-697f6c3d8639 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.122009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52f84-3c1c-4f8f-88b9-697f6c3d8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.124162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b7ff4fd5-cd33-45fd-a906-b696b39dcd02 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.125404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b7ff4fd5-cd33-45fd-a906-b696b39dcd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.141229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d4a52f84-3c1c-4f8f-88b9-697f6c3d8639 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.142413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d4a52f84-3c1c-4f8f-88b9-697f6c3d8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.186991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 784/1551] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.188330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefd12-cf0e-4ee0-b150-8ce6b204a069 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.188621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefd12-cf0e-4ee0-b150-8ce6b204a069 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.188899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefd12-cf0e-4ee0-b150-8ce6b204a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.205346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 768/1552] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.206976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.207394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.207870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.208800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9eeefd12-cf0e-4ee0-b150-8ce6b204a069 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.210057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9eeefd12-cf0e-4ee0-b150-8ce6b204a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.218153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 785/1553] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.219458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5c28a-2369-4b75-8d08-8c76cda62515 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.219752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5c28a-2369-4b75-8d08-8c76cda62515 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.220036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5c28a-2369-4b75-8d08-8c76cda62515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.230472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.231729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.239873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f7f5c28a-2369-4b75-8d08-8c76cda62515 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.241074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f7f5c28a-2369-4b75-8d08-8c76cda62515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.242621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 769/1554] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.243817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.251315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 786/1555] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.253381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c5ec6-da13-4cee-90d2-852e27252b90 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.253837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c5ec6-da13-4cee-90d2-852e27252b90 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.254070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c5ec6-da13-4cee-90d2-852e27252b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.256192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55733a-9e4d-41e8-b2e3-953a1d43bcd6 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.263471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.264141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.264427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.264702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.265426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.267295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.277598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3b9c5ec6-da13-4cee-90d2-852e27252b90 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.279071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3b9c5ec6-da13-4cee-90d2-852e27252b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.279227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 770/1556] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:49.279744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.287745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 787/1557] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.289172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704c18-21c1-4340-9ef0-485f6bce6ff2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.289530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704c18-21c1-4340-9ef0-485f6bce6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.289881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f704c18-21c1-4340-9ef0-485f6bce6ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.291256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ee2e2-3433-4fdc-a6ee-caf5a613da33 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.295710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.296424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.296653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.297060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.297755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.298763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:44:49.298763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:44:49.298763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:44:49.300569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854edcb-259f-42c5-aade-8e5291bbe39e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.308795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1f704c18-21c1-4340-9ef0-485f6bce6ff2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.309988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1f704c18-21c1-4340-9ef0-485f6bce6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.317905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 788/1558] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.329649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d433d-c22f-466b-802e-40d6d4ad730c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.329649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d433d-c22f-466b-802e-40d6d4ad730c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.329649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d433d-c22f-466b-802e-40d6d4ad730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.337159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-939d433d-c22f-466b-802e-40d6d4ad730c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.338337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-939d433d-c22f-466b-802e-40d6d4ad730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.346574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 789/1559] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.347966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.348254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.348534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.355287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:49.366199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.367407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.375719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 790/1560] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.376480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.385929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9117dc9-a994-4ad8-bb60-3641abf3198e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.390883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.391570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.391854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.392128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.392919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:49.393221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.394825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.400584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 771/1561] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:49.402012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.409940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.409940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.410155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 791/1562] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:49.410155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.418584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3b21-4795-4ba1-a733-24674d3c2e26 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.421409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:49.422642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:49.423254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.423918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.424216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.425056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.425779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.427565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.431601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 772/1563] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:49.432513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.442150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 792/1564] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:49.442150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.452873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089ae12-757d-44f9-955e-597b6b18b103 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.452873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.452873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.452873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:44:49.453240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.453761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac85ed-ae96-43e0-bbdc-677d42b21fa6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.454392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:49.457327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.458037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.458390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.458824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.459586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:49.459898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.461528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.464855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 773/1565] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:49.465745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.476088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f19c7-80ac-494c-a80d-4b0039c68cf1 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.477595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 793/1566] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:49.478506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.480712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.490275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.490275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.490275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.490275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:49.490275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.490275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.490749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742baad4-16e8-4dad-8c40-e79dec992fd0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.495231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.496038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.496328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.496608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.497335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:49.497645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.505182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 774/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:49.505182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.505811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.517779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 794/1568] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:49.517779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.518065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297963-216f-4041-bd1e-83a744ccd47f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.523578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.524275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdcbf1-59a3-4289-b836-f341d17e58a5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.524392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.524566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.524848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.525639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.527277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.529006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.530205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.530205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.530205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.530865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.532063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:44:49.532063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:44:49.532063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:44:49.533267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.537799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 775/1569] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:49.538602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.548216 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd041f05-2935-413e-a0d0-84bfc793dd3d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.553780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.554526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.555023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.555736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.556505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:44:49.556821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.558417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.570973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 776/1570] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:44:49.574914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.581357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7acb9-bd4d-42bd-9f69-edd3c50877bb admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.585846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.586726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.587007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.587313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] PATH_INFO: `/v3/projects/f474f456861e40ee9eb654852f80f313/users/72deeff329a6482cbfdb828a1996b127/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.602221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f474f456861e40ee9eb654852f80f313, user_id=72deeff329a6482cbfdb828a1996b127, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.605246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.687253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 795/1571] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:49.688104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.727363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 777/1572] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:49 2022] PUT /identity/v3/projects/f474f456861e40ee9eb654852f80f313/users/72deeff329a6482cbfdb828a1996b127/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:49.728335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.753803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615605-4010-4d15-b682-e97b8b104672 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.798003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c2949-7d31-404f-9a76-cdee9d3f9c43 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:49.802925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.803564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.803860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.804144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.804969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.806877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.813168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:49.813841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:49.814126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:49.814404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:49.815105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:49.817110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:49.921800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 778/1573] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:49.922621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.953600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 796/1574] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/projects => generated 389 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:49.953600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:49.974278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:49.985787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ed635-eada-467a-85e9-323d533e4ccc admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.016981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:50.019915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d678b-7ea5-4503-99c2-ec08f46d18f5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.025598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.026714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.026714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.026905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.027599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.029529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.055300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.055300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.055300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.055300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.055936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.057916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.202796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 779/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.202796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.203235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 797/1576] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:49 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.203235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.274829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f7b8-9a03-4837-8343-0cbfc9b95dd0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.275116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91eb3-9449-4088-88b9-b9e62011fb40 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.279903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.280044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e37f8-5696-433b-b8f9-ee661d9a480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.280577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.280678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e37f8-5696-433b-b8f9-ee661d9a480d admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.280862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.280958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e37f8-5696-433b-b8f9-ee661d9a480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.281131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.281226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e37f8-5696-433b-b8f9-ee661d9a480d admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.281898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.282018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e37f8-5696-433b-b8f9-ee661d9a480d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.283541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.283907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e37f8-5696-433b-b8f9-ee661d9a480d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.293738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 780/1577] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:50.296366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.310118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010136-0851-4807-be6f-e50e0bcfb28e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.311204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.311870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.312158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.312440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.313129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.315647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.365943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 798/1578] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/projects => generated 391 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.367307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.367596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.367876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.386199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:50.387579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:50.388603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 781/1579] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.389411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.399836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3652060-60c9-404f-b8f6-6d273e2bb7a8 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.449439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 799/1580] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:50.450349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.457764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.458487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.458774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.459051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.459752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804c4f-d469-4e05-a32c-ad74a263f9c3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.460159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.461738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.464473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.465141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.465429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.465713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.466562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.468471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.570738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 782/1581] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.570738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.578432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eba6d8-9ee7-4729-93c8-5807ae1f14f4 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.583063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.583744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.584030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.584311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.584992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.586880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.596112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 800/1582] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.596112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.605811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cb4b3-8a83-4a2f-9f7f-ecc573941e07 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.610374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.611058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.611372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.612147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.612845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.614949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.623821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:50.699803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 783/1583] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.700262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 801/1584] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.700781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.701631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.707927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:50.711936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23892a92-70ff-4384-b0e9-8975dcca8d46 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.713886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d49a-c66b-4c15-83c2-4aacade631a2 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.716466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.717140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.717411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.717688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.718509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.718681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.719405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.719698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.719995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] PATH_INFO: `/v3/projects/e479d40ca57c46a1a4e1deb7a6b5376f/users/fcb281f8083a49fbad88ff29fd06fe2a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.720593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.739936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e479d40ca57c46a1a4e1deb7a6b5376f, user_id=fcb281f8083a49fbad88ff29fd06fe2a, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.742736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.835347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 802/1585] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:50 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:50.836158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.846956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2930-51af-4db9-b917-849639c56006 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.853475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 784/1586] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:50 2022] PUT /identity/v3/projects/e479d40ca57c46a1a4e1deb7a6b5376f/users/fcb281f8083a49fbad88ff29fd06fe2a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:50.854473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.905161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.905831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.906168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.906455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.907267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.909468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.910763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c03ab6-dcf8-4a65-8ce4-b327590dbdfb admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.914697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.915520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.915803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.916076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.919997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 803/1587] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:50.920855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.927058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.928746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.931728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612dddd-4558-4106-8f4b-dca2bafd5f2a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.936295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.936938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.937226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.937508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.938225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.938608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 785/1588] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:50.939440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.939966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.950564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5606b-3341-48f6-8c89-c54a1a908817 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.954072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 804/1589] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:50.954072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.955941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.957045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.957238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.957514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.958745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.960579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.962201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb66e1-53de-4157-97bc-66accf067836 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.966839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.967544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.967872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.968177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.968909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.970887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.972202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 786/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:50.973217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.984587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 805/1591] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:50.984587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:50.984855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde43d-4b73-4c11-bf51-53004831ce08 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.988805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085031e-eb12-4370-97ab-bb6d008e89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:50.989536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085031e-eb12-4370-97ab-bb6d008e89c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:50.990389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085031e-eb12-4370-97ab-bb6d008e89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:50.990707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085031e-eb12-4370-97ab-bb6d008e89c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:50.991499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085031e-eb12-4370-97ab-bb6d008e89c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:50.993198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085031e-eb12-4370-97ab-bb6d008e89c4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:50.994771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f404a85-fe66-497a-bca0-e2532b532c8c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:50.999644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.000320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.000586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.000863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.001584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.003232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.004123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 787/1592] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.005254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.005536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.005821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.018267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 806/1593] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.018267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.032587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59a55a-d62f-4d6d-b79c-98702a04a947 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.032951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] MFA Rules not processed for user `fcb281f8083a49fbad88ff29fd06fe2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:51.035314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:51.040736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.040736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.040736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.040736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.041243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.041520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.057965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 807/1594] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.058812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.070829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51f535-20c5-49ad-aab5-2e1d6657e4fe admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.076686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.077426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.077712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.078020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.078801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.081273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.092574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 808/1595] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.093548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.104937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb93ef-fd95-4b4a-a650-11f3fa499855 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.109796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.110578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.110876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.111188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.112513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.114191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.122879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 788/1596] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:51.123852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.130467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 809/1597] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.131730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.141806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e0c8-496e-4526-9fa9-d87b9cb727f4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.147664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.147916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b30377-2a45-4e5b-955e-eaf78398de19 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.148560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.148911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.149255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.150062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.152377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.153652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.154574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.154771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.155453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.155875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.158487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.164720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 789/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.165569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.178550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 810/1599] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.178761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1c7f-3f52-46d2-a569-f9ba0e866072 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.178887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.181448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.182276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.182570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.182851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.183645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.185258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.186348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ece2-e7a9-4eed-b3d0-d6669d78aabc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.193413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.194395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.194770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.195144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] PATH_INFO: `/v3/projects/ddcee48ecf6d4132a40fb625f930c43f/users/6a7cf8b784d44b5ebf246c9541e781d5/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.198430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 790/1600] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:51.198430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.210153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228b1e6-d101-4d43-b5d4-29964b0f4ee0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.214278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcee48ecf6d4132a40fb625f930c43f, user_id=6a7cf8b784d44b5ebf246c9541e781d5, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.215436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:44:51.215436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:44:51.215436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:44:51.216456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4507-0ea2-4c6d-9704-281c449bb02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.217472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.217662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4507-0ea2-4c6d-9704-281c449bb02d admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.218838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4507-0ea2-4c6d-9704-281c449bb02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.218838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4507-0ea2-4c6d-9704-281c449bb02d admin admin] PATH_INFO: `/v3/projects/ba3d181c1ef545a286e4604dfffe1b6b/users/95a22f129f5141ec8e4643ddd89a17c5/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.242393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4507-0ea2-4c6d-9704-281c449bb02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3d181c1ef545a286e4604dfffe1b6b, user_id=95a22f129f5141ec8e4643ddd89a17c5, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.245504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4507-0ea2-4c6d-9704-281c449bb02d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.326221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 811/1601] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:51 2022] PUT /identity/v3/projects/ddcee48ecf6d4132a40fb625f930c43f/users/6a7cf8b784d44b5ebf246c9541e781d5/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:51.327161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.358858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 791/1602] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:51 2022] PUT /identity/v3/projects/ba3d181c1ef545a286e4604dfffe1b6b/users/95a22f129f5141ec8e4643ddd89a17c5/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:51.358858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0155-77b3-475f-af54-e2b2b01898e9 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.358858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0155-77b3-475f-af54-e2b2b01898e9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.358858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0155-77b3-475f-af54-e2b2b01898e9 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.363697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 792/1603] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 23 15:44:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:44:51.364470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0155-77b3-475f-af54-e2b2b01898e9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.366280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:51.375810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:51.395858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e8f4-23d5-4b1a-bb60-3043f39098e1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.444068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0155-77b3-475f-af54-e2b2b01898e9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.448869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.449597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.449940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.450146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] PATH_INFO: `/v3/projects/7651f704e84b4ce8bbd53a6292126bce/users/6d689e7ca175463ab0c319260ba49d0d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.458342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.459365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.459714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.460219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] PATH_INFO: `/v3/projects/611f73594c3d4780b8bd4decdc3ec6d5/users/3563f01a9a6a4a8ca3d35fc25644fd0d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.466204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7651f704e84b4ce8bbd53a6292126bce, user_id=6d689e7ca175463ab0c319260ba49d0d, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.469273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.476065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=611f73594c3d4780b8bd4decdc3ec6d5, user_id=3563f01a9a6a4a8ca3d35fc25644fd0d, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.479275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.542679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 812/1604] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:51 2022] PUT /identity/v3/projects/611f73594c3d4780b8bd4decdc3ec6d5/users/3563f01a9a6a4a8ca3d35fc25644fd0d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:51.544051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.559173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 793/1605] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:51 2022] PUT /identity/v3/projects/7651f704e84b4ce8bbd53a6292126bce/users/6d689e7ca175463ab0c319260ba49d0d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:51.559631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:51.615571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c072b-9a07-45fa-b9ca-51749cd73cbe admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.620658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837d51-3886-4365-9801-0035c4d528d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.621559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837d51-3886-4365-9801-0035c4d528d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.621837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837d51-3886-4365-9801-0035c4d528d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.622121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837d51-3886-4365-9801-0035c4d528d6 admin admin] PATH_INFO: `/v3/projects/9c021bc3b0a641c885f56c761164758f/users/01bbd426cdf144de99ee779535878b8c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.626868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca172dbb-5647-4331-a36e-e655ca6ac759 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:51.632743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957a632-3265-4951-9839-b1719c2a13ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:51.633653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957a632-3265-4951-9839-b1719c2a13ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.633951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957a632-3265-4951-9839-b1719c2a13ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.637090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957a632-3265-4951-9839-b1719c2a13ad admin admin] PATH_INFO: `/v3/projects/ad4a74e93cb54747a64778b2dbea9da8/users/606ff49786a04aa5b677cbb9a57b216c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.638338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837d51-3886-4365-9801-0035c4d528d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c021bc3b0a641c885f56c761164758f, user_id=01bbd426cdf144de99ee779535878b8c, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.641080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837d51-3886-4365-9801-0035c4d528d6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.650119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957a632-3265-4951-9839-b1719c2a13ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4a74e93cb54747a64778b2dbea9da8, user_id=606ff49786a04aa5b677cbb9a57b216c, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:51.652888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957a632-3265-4951-9839-b1719c2a13ad admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:51.776363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 813/1606] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:51 2022] PUT /identity/v3/projects/9c021bc3b0a641c885f56c761164758f/users/01bbd426cdf144de99ee779535878b8c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:51.776607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 794/1607] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:51 2022] PUT /identity/v3/projects/ad4a74e93cb54747a64778b2dbea9da8/users/606ff49786a04aa5b677cbb9a57b216c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:51.778143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b9a3-4d98-4714-b8cf-1d5ab3f172b5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.778514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b9a3-4d98-4714-b8cf-1d5ab3f172b5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.778717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394f0d-3708-4a2f-a81b-d53af7acfb86 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.778952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b9a3-4d98-4714-b8cf-1d5ab3f172b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.779950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394f0d-3708-4a2f-a81b-d53af7acfb86 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.780482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394f0d-3708-4a2f-a81b-d53af7acfb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.799309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9cb6b9a3-4d98-4714-b8cf-1d5ab3f172b5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:51.801357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9cb6b9a3-4d98-4714-b8cf-1d5ab3f172b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:51.813604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-97394f0d-3708-4a2f-a81b-d53af7acfb86 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:51.814929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97394f0d-3708-4a2f-a81b-d53af7acfb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:51.867763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 795/1608] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:51.869181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1736d28-8f24-4555-b2f1-ae4469faac3c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.869480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1736d28-8f24-4555-b2f1-ae4469faac3c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.869752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1736d28-8f24-4555-b2f1-ae4469faac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.885214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 814/1609] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 23 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:51.886528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d0e8-139a-478e-b876-de0a9f244ab7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.886820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d0e8-139a-478e-b876-de0a9f244ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.887119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d0e8-139a-478e-b876-de0a9f244ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.898700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f1736d28-8f24-4555-b2f1-ae4469faac3c None None] MFA Rules not processed for user `95a22f129f5141ec8e4643ddd89a17c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:51.899928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f1736d28-8f24-4555-b2f1-ae4469faac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:51.914218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d666d0e8-139a-478e-b876-de0a9f244ab7 None None] MFA Rules not processed for user `3563f01a9a6a4a8ca3d35fc25644fd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:51.915477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d666d0e8-139a-478e-b876-de0a9f244ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:51.927475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:51.969431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 796/1610] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:51.970746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97e68a-4efe-4caa-bbdf-95acb55030ef None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:51.971037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97e68a-4efe-4caa-bbdf-95acb55030ef None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:51.971343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97e68a-4efe-4caa-bbdf-95acb55030ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:51.997263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2a97e68a-4efe-4caa-bbdf-95acb55030ef None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:52.001479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:52.001479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2a97e68a-4efe-4caa-bbdf-95acb55030ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:52.011286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 815/1611] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:52.013555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.014193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.014620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.019246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 797/1612] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:52.019246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099291-224c-424f-b427-361f5125c101 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.019246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099291-224c-424f-b427-361f5125c101 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.019246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099291-224c-424f-b427-361f5125c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.046857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-45099291-224c-424f-b427-361f5125c101 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:52.048110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-45099291-224c-424f-b427-361f5125c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:52.058509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 798/1613] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:52.060476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099291-224c-424f-b427-361f5125c101 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.072223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] MFA Rules not processed for user `01bbd426cdf144de99ee779535878b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:52.073575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:52.118781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099291-224c-424f-b427-361f5125c101 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.123172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.123840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.124221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.124508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.137176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.138689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.141188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 816/1614] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:52.142122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.148888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 799/1615] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:52.149757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.155143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809618-d1ca-4874-bcb9-dd3eb84cdaec None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.159888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e39f-5c0d-4ca9-aea5-4b828c1d87f7 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.166359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.166359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.166359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.166359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.167001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9440-c64d-411f-bff2-1beb1141c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.167001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9440-c64d-411f-bff2-1beb1141c41f admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.167001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9440-c64d-411f-bff2-1beb1141c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.167001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9440-c64d-411f-bff2-1beb1141c41f admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.167368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9440-c64d-411f-bff2-1beb1141c41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.169350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9440-c64d-411f-bff2-1beb1141c41f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.223243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.224847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.233716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 817/1616] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:52.234538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.244523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b438297-76ec-493c-9f76-ec308a90ef2a service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.248144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed959b-7067-405b-84ef-84cd1ea09c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.255631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed959b-7067-405b-84ef-84cd1ea09c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.255631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed959b-7067-405b-84ef-84cd1ea09c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.255631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed959b-7067-405b-84ef-84cd1ea09c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.259413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed959b-7067-405b-84ef-84cd1ea09c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.260846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed959b-7067-405b-84ef-84cd1ea09c4f service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.272772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 818/1617] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:52.274336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db98ad4-3ecb-4b61-9511-b48c3dc307d9 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.274775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db98ad4-3ecb-4b61-9511-b48c3dc307d9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.275129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db98ad4-3ecb-4b61-9511-b48c3dc307d9 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.276712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 819/1618] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 23 15:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:44:52.282228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db98ad4-3ecb-4b61-9511-b48c3dc307d9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.298002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db98ad4-3ecb-4b61-9511-b48c3dc307d9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.302428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.303824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.303944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.304171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.314073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.315584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.333430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 800/1619] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:44:52 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:52.334933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.335264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.335552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.335764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 820/1620] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:52.343955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.362401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:52.363678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:52.367044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60e349-20f6-453c-88dd-02890cd771af service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.483745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.484513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.485424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.485424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.490083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.492234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.528944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 801/1621] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 23 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:52.529959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.544240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85063-5f46-4361-92c2-56c8b34cdc83 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.551319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.552035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.552373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.552654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.604421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 821/1622] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:44:52 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:44:52.608845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.617826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c160-3537-4511-a0b3-a97da01ca434 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.623932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.624337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.624649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.624925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.628281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.628281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.633981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.636240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.656649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 822/1623] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:52.656649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.656947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 802/1624] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:52.658290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.672884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c982-88c6-4b83-a344-d58c88d1458b service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.679131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.680347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.680859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.681368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] PATH_INFO: `/v3/projects/28607032e95746f29784ad6d6d01f3b9/users/0c9152968dd94ea78c2ab938f7c7c66c/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.684195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fe9ba-aa22-449b-acb6-d266c7357edd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.699577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa7f4-07d2-4e93-a17b-5e4bd8df9de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.700391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa7f4-07d2-4e93-a17b-5e4bd8df9de9 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.703830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa7f4-07d2-4e93-a17b-5e4bd8df9de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.703830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa7f4-07d2-4e93-a17b-5e4bd8df9de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.704102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28607032e95746f29784ad6d6d01f3b9, user_id=0c9152968dd94ea78c2ab938f7c7c66c, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.704555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.739025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:52.792387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fa7f4-07d2-4e93-a17b-5e4bd8df9de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.798634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fa7f4-07d2-4e93-a17b-5e4bd8df9de9 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.811000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 803/1625] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:52 2022] PUT /identity/v3/projects/28607032e95746f29784ad6d6d01f3b9/users/0c9152968dd94ea78c2ab938f7c7c66c/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:52.815022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:52.821264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 823/1626] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:52.903155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:52.911069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc26a-7d6d-4857-8711-dc922508fda2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.911069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc26a-7d6d-4857-8711-dc922508fda2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.911069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc26a-7d6d-4857-8711-dc922508fda2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.911997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 824/1627] 10.222.0.32 () {54 vars in 912 bytes} [Mon May 23 15:44:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:44:52.918400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360631-4a3d-4b52-bab8-1270145593c9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.918694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360631-4a3d-4b52-bab8-1270145593c9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.919027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360631-4a3d-4b52-bab8-1270145593c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.932504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08040d-ca39-4fdf-bb62-4faa3095911f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:52.950514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6ff7b-182a-4a1c-949d-219223ee4864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:52.951411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6ff7b-182a-4a1c-949d-219223ee4864 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.951827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6ff7b-182a-4a1c-949d-219223ee4864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.952211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6ff7b-182a-4a1c-949d-219223ee4864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.953726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6ff7b-182a-4a1c-949d-219223ee4864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:52.957698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6ff7b-182a-4a1c-949d-219223ee4864 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:52.978327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 804/1628] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:44:52.978327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6465-6f2a-4182-873d-0e7cb943dc8c None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:52.978327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6465-6f2a-4182-873d-0e7cb943dc8c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:52.978327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6465-6f2a-4182-873d-0e7cb943dc8c None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:52.980902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 805/1629] 10.222.0.32 () {54 vars in 912 bytes} [Mon May 23 15:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:44:52.980902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6465-6f2a-4182-873d-0e7cb943dc8c None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:53.007163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6465-6f2a-4182-873d-0e7cb943dc8c None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:53.012139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd0db6-c559-4652-bf89-c5343cc6fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:53.014191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0db6-c559-4652-bf89-c5343cc6fcab admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:53.014191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0db6-c559-4652-bf89-c5343cc6fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:53.014191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0db6-c559-4652-bf89-c5343cc6fcab admin admin] PATH_INFO: `/v3/projects/28607032e95746f29784ad6d6d01f3b9/users/0c9152968dd94ea78c2ab938f7c7c66c/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:53.016393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0db6-c559-4652-bf89-c5343cc6fcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=28607032e95746f29784ad6d6d01f3b9, user_id=0c9152968dd94ea78c2ab938f7c7c66c, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:53.019873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0db6-c559-4652-bf89-c5343cc6fcab admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:53.033821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 806/1630] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:44:52 2022] PUT /identity/v3/projects/28607032e95746f29784ad6d6d01f3b9/users/0c9152968dd94ea78c2ab938f7c7c66c/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:53.035453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:53.035883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:53.036322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:53.066746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:53.068534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:53.122536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-27360631-4a3d-4b52-bab8-1270145593c9 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:53.123830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-27360631-4a3d-4b52-bab8-1270145593c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:53.194368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:53.243879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 825/1631] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:53.245991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:53.245991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:53.246526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:53.274458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 807/1632] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:44:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:53.275730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:53.301915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] MFA Rules not processed for user `0c9152968dd94ea78c2ab938f7c7c66c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:53.311505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:53.336028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc62d6-89ad-4305-99f9-392b8fdaa264 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:53.344270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:53.344270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:53.344270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:53.344270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:53.355166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:53.356775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:53.369681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 808/1633] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:53.370737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:53.380897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c9665-ea5e-49d2-813e-f677d46a152c service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:53.385722 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59dd06-a98b-465f-a5a6-323e8b49bea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:53.386425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59dd06-a98b-465f-a5a6-323e8b49bea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:53.386823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59dd06-a98b-465f-a5a6-323e8b49bea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:53.387213 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59dd06-a98b-465f-a5a6-323e8b49bea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:53.405660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59dd06-a98b-465f-a5a6-323e8b49bea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:53.407223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59dd06-a98b-465f-a5a6-323e8b49bea0 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:53.426040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 809/1634] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:53.467645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 826/1635] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:53.598599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:54.805737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eec80-d853-4e16-8f22-4f7f204d8148 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:54.806351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eec80-d853-4e16-8f22-4f7f204d8148 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:54.806432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eec80-d853-4e16-8f22-4f7f204d8148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:54.878817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:54.884106 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-cb9eec80-d853-4e16-8f22-4f7f204d8148 None None] MFA Rules not processed for user `6a7cf8b784d44b5ebf246c9541e781d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:54.885500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cb9eec80-d853-4e16-8f22-4f7f204d8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:54.899186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03f8a4-5cd7-4ffa-a9a3-11806e282fd4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:54.910605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:54.911506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:54.912522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:54.913624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:54.937584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:54.939214 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:54.993575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 827/1636] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:44:55.046596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:55.113132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 810/1637] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:55.114305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:55.114305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:55.114522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:55.169073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] MFA Rules not processed for user `6a7cf8b784d44b5ebf246c9541e781d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:55.183740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:55.223526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 811/1638] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:55.246835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae79f-5c9e-4371-bfaf-6d1de60d3581 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:55.258519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:55.258519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:55.258519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:55.258809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] PATH_INFO: `/v3/users/95a22f129f5141ec8e4643ddd89a17c5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:55.260373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a22f129f5141ec8e4643ddd89a17c5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:55.261675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: WARNING py.warnings [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:44:55.261675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: warnings.warn(msg) May 23 15:44:55.261675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: May 23 15:44:55.264121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:55.358658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:55.378587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666742-09d8-43c1-a621-399d2cfdcbe7 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:55.386330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4881ae-9c7e-4e28-81a0-2c0fdd21ecaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:55.387199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4881ae-9c7e-4e28-81a0-2c0fdd21ecaa service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:55.387489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4881ae-9c7e-4e28-81a0-2c0fdd21ecaa service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:55.387873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4881ae-9c7e-4e28-81a0-2c0fdd21ecaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:55.399739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4881ae-9c7e-4e28-81a0-2c0fdd21ecaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:55.402593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4881ae-9c7e-4e28-81a0-2c0fdd21ecaa service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:55.417843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 812/1639] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:55.542404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a22f129f5141ec8e4643ddd89a17c5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:55.545310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a22f129f5141ec8e4643ddd89a17c5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:55.546815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a22f129f5141ec8e4643ddd89a17c5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:55.556354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:55.610391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a22f129f5141ec8e4643ddd89a17c5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:55.624577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a22f129f5141ec8e4643ddd89a17c5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:55.824403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 828/1640] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:44:55 2022] DELETE /identity/v3/users/95a22f129f5141ec8e4643ddd89a17c5 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:44:55.826520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0291-15cf-4b36-9772-1da6c65f10b7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:55.826989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0291-15cf-4b36-9772-1da6c65f10b7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:55.827226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0291-15cf-4b36-9772-1da6c65f10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:55.876566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f16b0291-15cf-4b36-9772-1da6c65f10b7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:55.877882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f16b0291-15cf-4b36-9772-1da6c65f10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:56.019527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:56.100336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 813/1641] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:56.116414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:56.118259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:56.258597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf315ef-8b02-45ad-aadd-3b42d5580091 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:56.273448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6afc3a-e839-44a2-a0cd-11bd6fb7faf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:56.274270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6afc3a-e839-44a2-a0cd-11bd6fb7faf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:56.274653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6afc3a-e839-44a2-a0cd-11bd6fb7faf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:56.275025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6afc3a-e839-44a2-a0cd-11bd6fb7faf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:56.289760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6afc3a-e839-44a2-a0cd-11bd6fb7faf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:56.292369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6afc3a-e839-44a2-a0cd-11bd6fb7faf1 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:56.318804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 829/1642] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:56.445248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7690e-c2a6-4750-8e42-4d5a9c4d9064 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:56.445636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7690e-c2a6-4750-8e42-4d5a9c4d9064 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:56.445995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7690e-c2a6-4750-8e42-4d5a9c4d9064 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:56.447499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 814/1643] 10.222.0.32 () {54 vars in 912 bytes} [Mon May 23 15:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:44:56.463078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:56.463922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:56.464369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:56.564677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:56.566465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:56.579850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 830/1644] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:44:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:44:56.604394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7690e-c2a6-4750-8e42-4d5a9c4d9064 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:56.607930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-05d7690e-c2a6-4750-8e42-4d5a9c4d9064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:56.640782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7690e-c2a6-4750-8e42-4d5a9c4d9064 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:56.650741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a99bb-3a7b-451c-8ae3-70ee2cd2761e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:56.651502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a99bb-3a7b-451c-8ae3-70ee2cd2761e service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:56.651894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a99bb-3a7b-451c-8ae3-70ee2cd2761e service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:56.652402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a99bb-3a7b-451c-8ae3-70ee2cd2761e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:56.663766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:56.665459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:56.671935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a99bb-3a7b-451c-8ae3-70ee2cd2761e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:56.675310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a99bb-3a7b-451c-8ae3-70ee2cd2761e service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:56.687013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 815/1645] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:56.703770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92240-311b-44ee-924a-590e10613da1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:56.717626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:56.718481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:56.718834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:56.719204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] PATH_INFO: `/v3/users/fcb281f8083a49fbad88ff29fd06fe2a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:56.723733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb281f8083a49fbad88ff29fd06fe2a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:56.725970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:56.986161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb281f8083a49fbad88ff29fd06fe2a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:56.988119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb281f8083a49fbad88ff29fd06fe2a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:56.990402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb281f8083a49fbad88ff29fd06fe2a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:57.019385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb281f8083a49fbad88ff29fd06fe2a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:57.033601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb281f8083a49fbad88ff29fd06fe2a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:57.183617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 831/1646] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:44:56 2022] DELETE /identity/v3/users/fcb281f8083a49fbad88ff29fd06fe2a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:57.188563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:57.188953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:57.189339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:57.223118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:57.225962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:57.324452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 816/1647] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:44:57.356369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:57.357850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:57.445358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:57.561415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4524-bb08-4edf-a1ab-724b99a8f96d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:57.569316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130aa04-d2e9-4fe7-9547-8ed7b6635797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:57.570006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130aa04-d2e9-4fe7-9547-8ed7b6635797 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:57.570298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130aa04-d2e9-4fe7-9547-8ed7b6635797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:57.570578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130aa04-d2e9-4fe7-9547-8ed7b6635797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:57.607567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130aa04-d2e9-4fe7-9547-8ed7b6635797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:57.610225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130aa04-d2e9-4fe7-9547-8ed7b6635797 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:57.643952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 832/1648] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:57.986337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:57.987958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:58.015973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a0fde-0b0d-4eb6-9b94-472808d57f3d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:58.030058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:58.031341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:58.031755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:58.032058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] PATH_INFO: `/v3/projects/ba3d181c1ef545a286e4604dfffe1b6b` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:58.034793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3d181c1ef545a286e4604dfffe1b6b)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:58.037007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: WARNING py.warnings [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:44:58.037007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: warnings.warn(msg) May 23 15:44:58.037007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: May 23 15:44:58.038236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:58.142178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284750-350b-4586-ad7d-48e2b27e45d5 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:58.142762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284750-350b-4586-ad7d-48e2b27e45d5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:58.143302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284750-350b-4586-ad7d-48e2b27e45d5 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:58.144997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 833/1649] 10.222.0.32 () {54 vars in 960 bytes} [Mon May 23 15:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:44:58.152130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:58.153180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:58.153914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:58.218460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:44:58.220609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:58.287027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3d181c1ef545a286e4604dfffe1b6b', 'request_id': 'req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:58.331970 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3d181c1ef545a286e4604dfffe1b6b', 'request_id': 'req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:58.340148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 834/1650] 10.222.0.32 () {58 vars in 1057 bytes} [Mon May 23 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:44:58.348130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:58.365837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3d181c1ef545a286e4604dfffe1b6b', 'request_id': 'req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:58.366996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0797e1-25f3-4618-bd34-b6267b5b6705 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:58.476640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] The token cache is being invalidate because project ba3d181c1ef545a286e4604dfffe1b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:44:58.477043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:58.478536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:58.480278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 817/1651] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:44:57 2022] DELETE /identity/v3/projects/ba3d181c1ef545a286e4604dfffe1b6b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:44:58.484527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:58.485952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:58.508416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:58.510427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:58.510728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:58.510992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:58.515795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:58.545454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:58.548656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:58.581961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 835/1652] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:44:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:44:58.700203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:58.711681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce99d-fd4e-489f-8d9d-fc3bc03cc96d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:58.725522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:58.726617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:58.726912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:58.727266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] PATH_INFO: `/v3/users/0c9152968dd94ea78c2ab938f7c7c66c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:58.729818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9152968dd94ea78c2ab938f7c7c66c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:58.732417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:59.054303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9152968dd94ea78c2ab938f7c7c66c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:59.148531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9152968dd94ea78c2ab938f7c7c66c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:59.149273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9152968dd94ea78c2ab938f7c7c66c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:59.191385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9152968dd94ea78c2ab938f7c7c66c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:59.213751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9152968dd94ea78c2ab938f7c7c66c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:44:59.251432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 818/1653] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:44:58 2022] DELETE /identity/v3/users/0c9152968dd94ea78c2ab938f7c7c66c => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:00.963064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:00.983000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88c278-524c-490a-b2f7-055642b986b2 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:01.108427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:01.112877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:01.174437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:01.193348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:01.194741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.195357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.195882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] PATH_INFO: `/v3/projects/28607032e95746f29784ad6d6d01f3b9` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.197467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28607032e95746f29784ad6d6d01f3b9)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:01.201522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:01.359382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af137bd-068b-4b62-81b3-ce36bd2e6a0f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:01.365453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:01.366446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.366893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.367289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] PATH_INFO: `/v3/projects/e479d40ca57c46a1a4e1deb7a6b5376f` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.369001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e479d40ca57c46a1a4e1deb7a6b5376f)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:01.371219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:01.429843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28607032e95746f29784ad6d6d01f3b9', 'request_id': 'req-55796c2e-1daa-40fb-a88d-2a4089af8219'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.501607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28607032e95746f29784ad6d6d01f3b9', 'request_id': 'req-55796c2e-1daa-40fb-a88d-2a4089af8219'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.511206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28607032e95746f29784ad6d6d01f3b9', 'request_id': 'req-55796c2e-1daa-40fb-a88d-2a4089af8219'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.523359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e479d40ca57c46a1a4e1deb7a6b5376f', 'request_id': 'req-3585b926-a27a-4d70-8a4b-0ce572d4c41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.535487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] The token cache is being invalidate because project 28607032e95746f29784ad6d6d01f3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:01.536108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.537007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-55796c2e-1daa-40fb-a88d-2a4089af8219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.547699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e479d40ca57c46a1a4e1deb7a6b5376f', 'request_id': 'req-3585b926-a27a-4d70-8a4b-0ce572d4c41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.547908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 836/1654] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:00 2022] DELETE /identity/v3/projects/28607032e95746f29784ad6d6d01f3b9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:01.550248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39e70-e0c0-4236-ac08-43876ce33093 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.550760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39e70-e0c0-4236-ac08-43876ce33093 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.551470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39e70-e0c0-4236-ac08-43876ce33093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.560898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e479d40ca57c46a1a4e1deb7a6b5376f', 'request_id': 'req-3585b926-a27a-4d70-8a4b-0ce572d4c41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.585753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fec39e70-e0c0-4236-ac08-43876ce33093 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:01.588283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fec39e70-e0c0-4236-ac08-43876ce33093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:01.686479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] The token cache is being invalidate because project e479d40ca57c46a1a4e1deb7a6b5376f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:01.686819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.687527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3585b926-a27a-4d70-8a4b-0ce572d4c41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:01.689402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 819/1655] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:01 2022] DELETE /identity/v3/projects/e479d40ca57c46a1a4e1deb7a6b5376f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:01.700237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426918-8f01-4469-aa21-c7c0578506c3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.700532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426918-8f01-4469-aa21-c7c0578506c3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.700808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426918-8f01-4469-aa21-c7c0578506c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.734810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:01.748752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 837/1656] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:01.757759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.759928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.760224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.765119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-14426918-8f01-4469-aa21-c7c0578506c3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:01.770575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-14426918-8f01-4469-aa21-c7c0578506c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:01.808517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 820/1657] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:01.823042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.823581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.824059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.831072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:01.832800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:01.858823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 838/1658] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:01.863453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:01.868350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:01.869861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:01.882365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88843aef-a746-46a2-90a0-df6d7d0eb7ca None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:01.892024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 821/1659] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:01.896523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:01.912662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:01.913524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.913822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.915074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.917293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37081f57-d7e5-4d44-aa25-848d532de71f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:01.919017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:01.919507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:01.921045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:01.929723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:01.930725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:01.931019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:01.933725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:01.934542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:01.934864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:01.936624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:01.958796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 839/1660] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:45:01.959500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:01.971706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 822/1661] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:01.972908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:01.981551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afecdd-12d2-4623-b16e-37d06631c6a1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.001236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d59938-aa3f-45c5-ab18-16947164ef16 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.007424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.008171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.008471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.008748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.009619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.012533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.018172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.018865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.019638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.019989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.020856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.022823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.163854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 840/1662] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:01 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:02.168764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.208248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 823/1663] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:01 2022] POST /identity/v3/projects => generated 405 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:02.213244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.305114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:02.361102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea678049-2cd2-40a7-8e4f-006a668ab795 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.385808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.386701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.386884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.387266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.387946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.390194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.391204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98710-ebe3-4f0a-96f2-1ec12667dda7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.410537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.411244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.411547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.411829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.412545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.414504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.505435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 841/1664] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:02 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:02.510697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.537106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6e8eb-730c-4cc0-9718-8a89cd4ab9e7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.560052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.568832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.569435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.570004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.571265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.572972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.593891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 824/1665] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:02 2022] POST /identity/v3/users => generated 303 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:02.595806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 842/1666] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:02.601520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.601685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.615582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbaf64-4d57-4e9c-b5d1-4336daff65d4 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.623633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.623969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e47d-57e3-4916-8c62-e97c34e6e677 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.624452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.624840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.633863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.633863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.633863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.650078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.651057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.651380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.651666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.652665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.654088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.680099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 843/1667] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:02.682302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.682838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 825/1668] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:02.684274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.712248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83328f-dc35-451e-b8ba-489d0ed1ad49 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.714907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf92e5a-67e2-48ec-888e-33e4ff184558 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:02.727342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.730274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.730562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.730838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] PATH_INFO: `/v3/projects/d8a81ec3a09447daa53c4c0e47913f46/users/0c0110bcb6194924860d8b8d38d914e4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.732512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec03f7-866b-4f04-9f31-12ce06a750ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:02.733731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec03f7-866b-4f04-9f31-12ce06a750ed admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.734021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec03f7-866b-4f04-9f31-12ce06a750ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.734295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec03f7-866b-4f04-9f31-12ce06a750ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.740592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec03f7-866b-4f04-9f31-12ce06a750ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.740592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec03f7-866b-4f04-9f31-12ce06a750ed admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.763418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 826/1669] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:02.764787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e94f0-c055-4db6-941d-b9107d8b3f00 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:02.765078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e94f0-c055-4db6-941d-b9107d8b3f00 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:02.765349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e94f0-c055-4db6-941d-b9107d8b3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:02.770076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a81ec3a09447daa53c4c0e47913f46, user_id=0c0110bcb6194924860d8b8d38d914e4, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:02.772388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:02.838302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b81e94f0-c055-4db6-941d-b9107d8b3f00 None None] MFA Rules not processed for user `72deeff329a6482cbfdb828a1996b127`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:02.841087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b81e94f0-c055-4db6-941d-b9107d8b3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:02.896157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 844/1670] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:02 2022] PUT /identity/v3/projects/d8a81ec3a09447daa53c4c0e47913f46/users/0c0110bcb6194924860d8b8d38d914e4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:02.897467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:02.997513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 827/1671] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:02.999190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.003174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.003708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.074181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] MFA Rules not processed for user `0c0110bcb6194924860d8b8d38d914e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:03.075777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:03.159980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daff67-3aa5-4670-8a7d-c0dc0293c463 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:03.177877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:03.184229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.186181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.187445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] PATH_INFO: `/v3/projects/8c727ae950224e02b19794d03c5bdf1e/users/e435905850c14349ba57f7a2cb3e5955/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.220856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 828/1672] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:03.222936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:03.224267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:03.249400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:03.275490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c727ae950224e02b19794d03c5bdf1e, user_id=e435905850c14349ba57f7a2cb3e5955, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:03.285334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:03.364694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 845/1673] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:02 2022] PUT /identity/v3/projects/8c727ae950224e02b19794d03c5bdf1e/users/e435905850c14349ba57f7a2cb3e5955/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:03.369573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:03.370854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5414-a40a-468e-8d8b-0c503d1ebc4f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:03.510498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e43e90-9e69-4256-baef-fd1084585690 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:03.523309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866b6ab-45a5-4d01-b6bc-094a4199022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:03.525405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866b6ab-45a5-4d01-b6bc-094a4199022c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.525924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866b6ab-45a5-4d01-b6bc-094a4199022c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.526030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866b6ab-45a5-4d01-b6bc-094a4199022c admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.526746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866b6ab-45a5-4d01-b6bc-094a4199022c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:03.530709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866b6ab-45a5-4d01-b6bc-094a4199022c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:03.542322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeda59-9397-4506-bd70-754fa6e8591e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:03.543019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeda59-9397-4506-bd70-754fa6e8591e service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.543503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeda59-9397-4506-bd70-754fa6e8591e service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.543810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeda59-9397-4506-bd70-754fa6e8591e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.619468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbeda59-9397-4506-bd70-754fa6e8591e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:03.621153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbeda59-9397-4506-bd70-754fa6e8591e service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:03.667529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 829/1674] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:03.673206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.673206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.673206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.673539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 846/1675] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:03.675474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.675820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.676118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.722438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:03.723730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:03.724440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] MFA Rules not processed for user `6d689e7ca175463ab0c319260ba49d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:03.725719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:03.838513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 830/1676] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:03.839856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:03.878424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85349b1-5990-41e0-b2b0-eae197f95b3b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:03.890168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 847/1677] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:03.890168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:03.892418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:03.894233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:03.895027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:03.895463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:03.895707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:03.898920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:03.903825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:03.911749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:04.033771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eac10-e86a-4f17-8633-b3ba4dfa25d3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:04.033771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:04.033771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.033771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.034140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.050503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:04.052794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:04.069235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 848/1678] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:04.071244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:04.072837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:04.105752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 831/1679] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:03 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:04.111327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:04.133932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f087351-d97d-490a-9a49-d78e25785bae admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:04.149671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:04.150375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.150664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.150947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.151719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:04.153373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:04.179146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 832/1680] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:04.182142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:04.199475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1352b3c-9d34-481a-9677-c0ac9731e11a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:04.206075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:04.206783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.207075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.211766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.211766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:04.211766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:04.240268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 833/1681] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:04.244630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:04.268655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a53c7-cb26-45df-a550-796f2ba7109a service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:04.272856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e269-2247-4853-a79f-8394c96203c5 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:04.280858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293a81-d71e-4a9c-b742-618242903735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:04.282119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293a81-d71e-4a9c-b742-618242903735 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.284205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293a81-d71e-4a9c-b742-618242903735 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.284526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293a81-d71e-4a9c-b742-618242903735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.286117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:04.288634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.290424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.290790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] PATH_INFO: `/v3/projects/9375dc4592e14317896f0d538043cbf2/users/086042278a1346a4b78524e2dfb2cc5e/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.305335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293a81-d71e-4a9c-b742-618242903735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:04.309167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293a81-d71e-4a9c-b742-618242903735 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:04.327450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9375dc4592e14317896f0d538043cbf2, user_id=086042278a1346a4b78524e2dfb2cc5e, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:04.332449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:04.332973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 849/1682] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:04.431429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 834/1683] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:04 2022] PUT /identity/v3/projects/9375dc4592e14317896f0d538043cbf2/users/086042278a1346a4b78524e2dfb2cc5e/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:04.444569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.444882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.445147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.541740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] MFA Rules not processed for user `086042278a1346a4b78524e2dfb2cc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:04.543520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:04.753666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 850/1684] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:04.754384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:04.758052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:04.944154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ed7e1-afb7-4b8c-93c2-9b2fae1afd87 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:04.958220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:04.962973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:04.962973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:04.963935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:04.978778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:04.989005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:05.188225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 835/1685] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:04 2022] POST /identity/v3/projects => generated 387 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:05.192735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:05.213058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f8b84-e871-416e-8b06-c27aa5e4ac3a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:05.328372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:05.329713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:05.329713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:05.330013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:05.330783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:05.335310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:05.493329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 851/1686] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:05 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:05.501449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:05.520812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a8cd3-e5b0-4ed4-853a-6498ff1db7fb admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:05.542219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:05.543021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:05.543404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:05.543961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:05.544838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:05.546935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:05.570236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:05.598045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 836/1687] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:05.600559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:05.615299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44089ea-a98d-438e-94b6-36bc4e2d479b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:05.629957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:05.631001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:05.631907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:05.631907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] PATH_INFO: `/v3/projects/928ce8122cad4853962beaa857efdc40/users/6655f2e3083d4598b044b5f679eb71a3/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:05.696843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928ce8122cad4853962beaa857efdc40, user_id=6655f2e3083d4598b044b5f679eb71a3, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:05.700291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:05.744226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:05.895016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 852/1688] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:05 2022] PUT /identity/v3/projects/928ce8122cad4853962beaa857efdc40/users/6655f2e3083d4598b044b5f679eb71a3/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:05.899443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:05.921509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd028-2fcb-44ea-8cfc-516657e66229 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:06.168773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:06.170991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:06.171742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:06.172348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:06.173835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:06.176558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:06.224383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:06.226737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:06.255340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 837/1689] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:06.256394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:06.264546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4009d7-357d-4bed-8ba5-7fb1984c3b83 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:06.284462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5f16e-6bfd-4a79-8369-732c4339d587 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:06.285982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:06.292418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142773-b6da-4a53-af00-9d79ff082999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:06.293148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:06.293343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142773-b6da-4a53-af00-9d79ff082999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:06.293789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:06.293910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142773-b6da-4a53-af00-9d79ff082999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:06.294373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142773-b6da-4a53-af00-9d79ff082999 admin admin] PATH_INFO: `/v3/projects/928ce8122cad4853962beaa857efdc40/users/6655f2e3083d4598b044b5f679eb71a3/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:06.294620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] PATH_INFO: `/v3/users/3563f01a9a6a4a8ca3d35fc25644fd0d` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:06.298724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9142773-b6da-4a53-af00-9d79ff082999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928ce8122cad4853962beaa857efdc40, user_id=6655f2e3083d4598b044b5f679eb71a3, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:06.305022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3563f01a9a6a4a8ca3d35fc25644fd0d)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:06.305022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:06.314429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9142773-b6da-4a53-af00-9d79ff082999 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:06.339272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 838/1690] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:06 2022] PUT /identity/v3/projects/928ce8122cad4853962beaa857efdc40/users/6655f2e3083d4598b044b5f679eb71a3/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:06.350230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:06.350770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:06.351259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:06.437166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] MFA Rules not processed for user `6655f2e3083d4598b044b5f679eb71a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:06.438610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:06.554518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3563f01a9a6a4a8ca3d35fc25644fd0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:06.555472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3563f01a9a6a4a8ca3d35fc25644fd0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:06.557754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3563f01a9a6a4a8ca3d35fc25644fd0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:06.598009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3563f01a9a6a4a8ca3d35fc25644fd0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:06.637839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-85b95588-3222-4ce9-a24e-fd42bf68ccd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3563f01a9a6a4a8ca3d35fc25644fd0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:06.647690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 839/1691] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:06.662131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:06.669408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:06.797903 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 853/1692] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:06 2022] DELETE /identity/v3/users/3563f01a9a6a4a8ca3d35fc25644fd0d => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:06.800910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:06.801478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:06.802120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:06.806317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada616ea-ffaa-4684-aec3-791a95f9c703 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:06.839417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:06.842208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:06.950530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70169e8-d0c4-45c9-8a42-7e24bef66acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:06.951365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70169e8-d0c4-45c9-8a42-7e24bef66acb service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:06.951659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70169e8-d0c4-45c9-8a42-7e24bef66acb service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:06.951940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70169e8-d0c4-45c9-8a42-7e24bef66acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:07.020968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 854/1693] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:07.053155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:07.054853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:07.153197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70169e8-d0c4-45c9-8a42-7e24bef66acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:07.155610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70169e8-d0c4-45c9-8a42-7e24bef66acb service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:07.157049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c970-2e02-44dd-a091-6ae2c195c3a2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:07.162363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde9379-f33c-490b-8364-b94974f4743b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:07.163171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde9379-f33c-490b-8364-b94974f4743b service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:07.163530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde9379-f33c-490b-8364-b94974f4743b service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:07.164099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde9379-f33c-490b-8364-b94974f4743b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:07.171860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 840/1694] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:07.179641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde9379-f33c-490b-8364-b94974f4743b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:07.181110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde9379-f33c-490b-8364-b94974f4743b service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:07.200180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 855/1695] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:07.206886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:07.304493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:07.324576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:07.325083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:07.325371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:07.363308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:07.365110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:07.493906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 841/1696] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:07.947404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8c532-be82-4871-81bb-6690501a355c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:07.947913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8c532-be82-4871-81bb-6690501a355c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:07.948012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8c532-be82-4871-81bb-6690501a355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:08.004947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-24a8c532-be82-4871-81bb-6690501a355c None None] MFA Rules not processed for user `606ff49786a04aa5b677cbb9a57b216c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:08.006955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-24a8c532-be82-4871-81bb-6690501a355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:08.213372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:08.214926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:08.280942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 856/1697] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:08.293789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:08.294507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:08.295616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:08.328554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] MFA Rules not processed for user `606ff49786a04aa5b677cbb9a57b216c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:08.330156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:08.351249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 857/1698] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:08.362795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:08.366101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:08.436474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e498-cfed-40f8-af48-c5c3fdf8a9c9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:08.455464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:08.456450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:08.456779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:08.457066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:08.479342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:08.487974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:08.497925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89035b80-f5e7-4e91-9ed9-fe83a3bf4ca2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:08.506314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0070b7f-29bc-48ea-bb66-819f52c2d912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:08.507649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0070b7f-29bc-48ea-bb66-819f52c2d912 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:08.508043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0070b7f-29bc-48ea-bb66-819f52c2d912 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:08.512628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0070b7f-29bc-48ea-bb66-819f52c2d912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:08.533855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0070b7f-29bc-48ea-bb66-819f52c2d912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:08.535770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0070b7f-29bc-48ea-bb66-819f52c2d912 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:08.539273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 842/1699] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:45:08.540156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:08.551932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:08.558081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 858/1700] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:08.650944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2828c6-8936-434f-ba19-3e655ed2eaee service swift] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:08.672581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:08.677938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:08.679252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:08.679551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] PATH_INFO: `/v3/projects/611f73594c3d4780b8bd4decdc3ec6d5` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:08.688353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611f73594c3d4780b8bd4decdc3ec6d5)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:08.695298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:08.823412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2ebe-de90-471d-995a-e11dccbe4c59 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:08.824696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2ebe-de90-471d-995a-e11dccbe4c59 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:08.825371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2ebe-de90-471d-995a-e11dccbe4c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:08.966103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-97fe2ebe-de90-471d-995a-e11dccbe4c59 None None] MFA Rules not processed for user `e435905850c14349ba57f7a2cb3e5955`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:08.995141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611f73594c3d4780b8bd4decdc3ec6d5', 'request_id': 'req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:08.995585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97fe2ebe-de90-471d-995a-e11dccbe4c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:09.021657 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611f73594c3d4780b8bd4decdc3ec6d5', 'request_id': 'req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.072733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611f73594c3d4780b8bd4decdc3ec6d5', 'request_id': 'req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.195467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] The token cache is being invalidate because project 611f73594c3d4780b8bd4decdc3ec6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:09.195763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.206071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.206071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:09.207761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 843/1701] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:08 2022] DELETE /identity/v3/projects/611f73594c3d4780b8bd4decdc3ec6d5 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:09.214925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:09.218935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:09.442488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e17c0-a568-4b53-ab56-e8470f4f4c58 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:09.448506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:09.450002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:09.450295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:09.450620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] PATH_INFO: `/v3/users/01bbd426cdf144de99ee779535878b8c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:09.453213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 859/1702] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 631 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:09.453954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01bbd426cdf144de99ee779535878b8c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:09.457104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:09.464249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:09.464684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:09.464973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:09.520376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:09.521888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:09.548300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 860/1703] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:09.549985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:09.557525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:09.733506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01bbd426cdf144de99ee779535878b8c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.761897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c21be-4b4e-41d9-88fc-ffd8e2af975b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:09.771276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:09.772115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:09.774167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:09.774450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:09.781719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:09.851666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01bbd426cdf144de99ee779535878b8c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.852311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01bbd426cdf144de99ee779535878b8c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.892313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01bbd426cdf144de99ee779535878b8c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.921033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01bbd426cdf144de99ee779535878b8c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:09.952870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 844/1704] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:09 2022] DELETE /identity/v3/users/01bbd426cdf144de99ee779535878b8c => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:09.952870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:09.957345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:09.978203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:09.980246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:10.004822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9569aa8-8997-4e23-bc36-fcd2d13c66cf service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:10.029502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 861/1705] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:10.031144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756df246-dd82-47ac-aba8-4486d872980d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.032241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756df246-dd82-47ac-aba8-4486d872980d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.036313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756df246-dd82-47ac-aba8-4486d872980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.089080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-756df246-dd82-47ac-aba8-4486d872980d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:10.090687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-756df246-dd82-47ac-aba8-4486d872980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:10.260403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e61da-f7a9-4b0a-a429-1bb243aadd5d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:10.260403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:10.260403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.260403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.262510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.262510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:10.262810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 862/1706] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:10.262810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.262810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.263014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:10.263753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.299742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:10.303602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:10.323252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 863/1707] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:10.324722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:10.357836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07584b-4371-43c1-bd63-03baed7b051c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:10.376408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:10.377665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.378055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.378431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.379498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:10.380093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:10.384722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:10.431554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 864/1708] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:10.435806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:10.441935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 845/1709] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:09 2022] POST /identity/v3/projects => generated 405 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:10.443310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:10.447292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:10.450991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:10.690840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475b7e-fa85-40ff-9176-c2b252e38f91 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:10.711588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf3d0a-4361-4048-bf9c-163f21a47583 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:10.737264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:10.738088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.738373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.738687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.739528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:10.741623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:10.804240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:10.805451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.805959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.806460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.840038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:10.843227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:10.869043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 865/1710] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:10.877729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:10.898782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c92e99-a743-4916-8239-157d9a0c152a service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:10.911536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:10.911764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 846/1711] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:10 2022] POST /identity/v3/projects => generated 365 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:10.912758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:10.913264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:10.913779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:10.915108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:10.921049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:10.924060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:11.151881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 866/1712] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:10 2022] POST /identity/v3/users => generated 309 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:11.155905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:11.157080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51fb04-c581-4dd6-a0c8-7b801a0688ea admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:11.175046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:11.177443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.177443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.177443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.177850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69423d7-3ff4-4d37-8038-ef4e5dc1b0f1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:11.182123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:11.184301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:11.200395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:11.201088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.201382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.201662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.202405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:11.208536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:11.241402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 867/1713] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:11.246163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:11.305568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a80468-66b8-4ded-91ae-be7e8058bf23 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:11.327575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 847/1714] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:10 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:11.337420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:11.359797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:11.360726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.361012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.368898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] PATH_INFO: `/v3/projects/54fc91fb58bc4ee683eb0fcd79e0708c/users/b071201e9357449baec7ba338ff19ac1/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.413397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55a7d-d649-4dda-bf12-5a825e3fc117 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:11.445738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:11.450113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc91fb58bc4ee683eb0fcd79e0708c, user_id=b071201e9357449baec7ba338ff19ac1, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:11.462286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.462677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.462944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.463779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:11.471851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:11.477754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:11.543356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 848/1715] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:11.559930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:11.605680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fe30a-7fa6-4f17-b2a5-3a8293b6dabb admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:11.636962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 868/1716] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:11 2022] PUT /identity/v3/projects/54fc91fb58bc4ee683eb0fcd79e0708c/users/b071201e9357449baec7ba338ff19ac1/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:11.641714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:11.647908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752268-2e97-47c0-9cbf-2c5839888857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:11.648626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752268-2e97-47c0-9cbf-2c5839888857 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.648911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752268-2e97-47c0-9cbf-2c5839888857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.649210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752268-2e97-47c0-9cbf-2c5839888857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.659238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752268-2e97-47c0-9cbf-2c5839888857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:11.663434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752268-2e97-47c0-9cbf-2c5839888857 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:11.732667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 849/1717] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:11.743636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.744421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.744533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.850358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] MFA Rules not processed for user `6d689e7ca175463ab0c319260ba49d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:11.858189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:11.942109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976d03-41c8-4d93-9468-35a7036772ce admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:11.979775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c592-f40d-41a1-a4c3-1b3924e7806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:11.981206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c592-f40d-41a1-a4c3-1b3924e7806b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:11.981735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c592-f40d-41a1-a4c3-1b3924e7806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:11.982233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c592-f40d-41a1-a4c3-1b3924e7806b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:11.989477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27c592-f40d-41a1-a4c3-1b3924e7806b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:11.994768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27c592-f40d-41a1-a4c3-1b3924e7806b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:12.065170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 869/1718] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:12.070866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f7979-24c8-405c-95ca-0a570aa95e06 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:12.071239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f7979-24c8-405c-95ca-0a570aa95e06 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:12.071541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f7979-24c8-405c-95ca-0a570aa95e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:12.162923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 850/1719] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:12.167916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:12.185396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-760f7979-24c8-405c-95ca-0a570aa95e06 None None] MFA Rules not processed for user `606ff49786a04aa5b677cbb9a57b216c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:12.197872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-760f7979-24c8-405c-95ca-0a570aa95e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:12.214276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68239-f444-4c90-a52c-b29f3d590778 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:12.230180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:12.248200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:12.258879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:12.259089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] PATH_INFO: `/v3/projects/eb2d5fbc70f04548b7f66feb51a01419/users/fd81ed2a866a4e0e8ef9c5088ed5a432/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:12.354552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2d5fbc70f04548b7f66feb51a01419, user_id=fd81ed2a866a4e0e8ef9c5088ed5a432, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:12.371444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:12.421621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 870/1720] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:12.423386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374dba-0e2b-4b70-91fd-a8e38c5d6959 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:12.423786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374dba-0e2b-4b70-91fd-a8e38c5d6959 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:12.427074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374dba-0e2b-4b70-91fd-a8e38c5d6959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:12.480418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-86374dba-0e2b-4b70-91fd-a8e38c5d6959 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:12.481453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 851/1721] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:12 2022] PUT /identity/v3/projects/eb2d5fbc70f04548b7f66feb51a01419/users/fd81ed2a866a4e0e8ef9c5088ed5a432/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:12.482126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:12.492318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-86374dba-0e2b-4b70-91fd-a8e38c5d6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:12.646559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 871/1722] 10.222.0.62 () {58 vars in 1015 bytes} [Mon May 23 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:12.659136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:12.659541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:12.659831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:12.733571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] MFA Rules not processed for user `fd81ed2a866a4e0e8ef9c5088ed5a432`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:12.733806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f156fd-69e8-47c0-9ef9-582d4051e2be admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:12.735537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:12.759170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:12.760247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:12.766037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:12.766442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] PATH_INFO: `/v3/projects/54fc91fb58bc4ee683eb0fcd79e0708c/users/b071201e9357449baec7ba338ff19ac1/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:12.773012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc91fb58bc4ee683eb0fcd79e0708c, user_id=b071201e9357449baec7ba338ff19ac1, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:12.776779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:12.832014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 872/1723] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:12.843977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:12.846315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:12.869530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 852/1724] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:12 2022] PUT /identity/v3/projects/54fc91fb58bc4ee683eb0fcd79e0708c/users/b071201e9357449baec7ba338ff19ac1/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:12.892563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:13.038398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f2f55-6c60-4949-8e2c-4fa20b39c282 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:13.132232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e5f53-f981-4662-8239-960652f1b7e1 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:13.145811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:13.149241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:13.149619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:13.151775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:13.167345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7d8e-a1d3-433f-ae9a-d6145b534e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:13.168030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7d8e-a1d3-433f-ae9a-d6145b534e44 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:13.168363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7d8e-a1d3-433f-ae9a-d6145b534e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:13.168719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7d8e-a1d3-433f-ae9a-d6145b534e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:13.173864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:13.177628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:13.203592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 853/1725] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:13.377885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a7d8e-a1d3-433f-ae9a-d6145b534e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:13.382807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a7d8e-a1d3-433f-ae9a-d6145b534e44 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:13.413393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 873/1726] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:13.556968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:13.569122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:13.737499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c62d-fbf0-44f3-9d20-c6fc4e2c7f8d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:13.738158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c62d-fbf0-44f3-9d20-c6fc4e2c7f8d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:13.738680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c62d-fbf0-44f3-9d20-c6fc4e2c7f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:13.846002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b442c62d-fbf0-44f3-9d20-c6fc4e2c7f8d None None] MFA Rules not processed for user `72deeff329a6482cbfdb828a1996b127`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:13.857888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b442c62d-fbf0-44f3-9d20-c6fc4e2c7f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:14.029049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fe23-ae3f-48a1-8abb-516009e35d0c service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:14.056184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:14.057256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:14.057707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:14.058129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] PATH_INFO: `/v3/projects/9c021bc3b0a641c885f56c761164758f` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:14.072866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c021bc3b0a641c885f56c761164758f)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:14.074888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:14.080858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:14.213345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 874/1727] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:14.289965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c37ad9-69fd-4cf3-bd86-9b642b3d0cf2 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:14.290251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c37ad9-69fd-4cf3-bd86-9b642b3d0cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:14.290722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c37ad9-69fd-4cf3-bd86-9b642b3d0cf2 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:14.292463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 875/1728] 10.222.0.32 () {54 vars in 912 bytes} [Mon May 23 15:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:45:14.304213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:14.304817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:14.305260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:14.374317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:14.376249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:14.386789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c021bc3b0a641c885f56c761164758f', 'request_id': 'req-d733149a-5743-4ef8-99e3-dfb09c22267b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:14.402857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c021bc3b0a641c885f56c761164758f', 'request_id': 'req-d733149a-5743-4ef8-99e3-dfb09c22267b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:14.417387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c021bc3b0a641c885f56c761164758f', 'request_id': 'req-d733149a-5743-4ef8-99e3-dfb09c22267b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:14.435645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:14.482114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 876/1729] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:14.485406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:14.485406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:14.499308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] The token cache is being invalidate because project 9c021bc3b0a641c885f56c761164758f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:14.499686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:14.500474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d733149a-5743-4ef8-99e3-dfb09c22267b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:14.501803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d3c1-0e0c-4f11-bc82-af6b2611ae03 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:14.507296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 854/1730] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:13 2022] DELETE /identity/v3/projects/9c021bc3b0a641c885f56c761164758f => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:14.508941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:14.509730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:14.510534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:14.510888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:14.510995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:14.511420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:14.511628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:14.514402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:14.531721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:14.535844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b53415-8f79-4b39-bb9f-89c452b93e56 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:14.549985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 877/1731] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:14.595380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:14.599415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:14.802743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:14.802980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 855/1732] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:14.803327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:14.803681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:14.906346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:14.907740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:14.963413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:14.969973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 878/1733] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:14.991596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4c23a-c2bb-49a8-9f9a-14bc7a880978 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:15.020902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:15.027877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:15.029100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:15.030689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:15.038312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:15.038792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:15.051933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:15.133658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:15.136557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 856/1734] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:45:15.165445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c36f7-2052-4dd7-949d-7561003a10e7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:15.186978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:15.188399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:15.188655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:15.188987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:15.192096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:15.198763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:15.353339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 879/1735] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:15 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:15.357554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:15.386745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6ee3-5f87-4e99-8117-a85b4f5cc413 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:15.553491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:15.554424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:15.555068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:15.556026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:15.556902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:15.560377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:15.745027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 857/1736] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:15 2022] POST /identity/v3/users => generated 282 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:15.745667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:15.767787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5642d9a-5b28-480e-9114-9afe31ae75a4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:15.794941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:15.798060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:15.798060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:15.798060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:15.798060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:15.799852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:15.804398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:15.836755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 880/1737] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:15.840496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:15.864994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1fe6-a1e9-42ab-9828-d2d2fddf761a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:15.883551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756e90-c130-40b4-897f-910ec6e21c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:15.886963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756e90-c130-40b4-897f-910ec6e21c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:15.886963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756e90-c130-40b4-897f-910ec6e21c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:15.886963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756e90-c130-40b4-897f-910ec6e21c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:15.886963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756e90-c130-40b4-897f-910ec6e21c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:15.889250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756e90-c130-40b4-897f-910ec6e21c88 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:15.936949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:15.949136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 858/1738] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:15.950636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73234bab-eb8b-460e-aefd-59b16fa21e45 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:15.972263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebd4c9-ebe0-48a0-b62d-9e37f70300eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:15.973496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebd4c9-ebe0-48a0-b62d-9e37f70300eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:15.973963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebd4c9-ebe0-48a0-b62d-9e37f70300eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:15.974393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebd4c9-ebe0-48a0-b62d-9e37f70300eb admin admin] PATH_INFO: `/v3/projects/00dde74441554affb2d818c43dd005f1/users/3f68e81f80e34f9cac9cb0da50d77ac8/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:16.041990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebd4c9-ebe0-48a0-b62d-9e37f70300eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=00dde74441554affb2d818c43dd005f1, user_id=3f68e81f80e34f9cac9cb0da50d77ac8, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:16.046746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebd4c9-ebe0-48a0-b62d-9e37f70300eb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:16.248192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 881/1739] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:15 2022] PUT /identity/v3/projects/00dde74441554affb2d818c43dd005f1/users/3f68e81f80e34f9cac9cb0da50d77ac8/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:16.264327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de833721-2391-484c-9753-287fb550b783 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:16.266954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de833721-2391-484c-9753-287fb550b783 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:16.267425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de833721-2391-484c-9753-287fb550b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:16.342386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-de833721-2391-484c-9753-287fb550b783 None None] MFA Rules not processed for user `3f68e81f80e34f9cac9cb0da50d77ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:16.345212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-de833721-2391-484c-9753-287fb550b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:16.533175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55096bf-4041-478f-8d5a-721b83e5d393 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:16.533823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55096bf-4041-478f-8d5a-721b83e5d393 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:16.534300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55096bf-4041-478f-8d5a-721b83e5d393 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:16.536285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 882/1740] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:45:16.537298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55096bf-4041-478f-8d5a-721b83e5d393 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:16.544695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 859/1741] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:16.599792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:16.600310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:16.600727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:16.697699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:16.701299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:16.771077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55096bf-4041-478f-8d5a-721b83e5d393 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:16.805038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:16.805990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:16.806119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:16.806375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:16.807126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:16.809262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:16.935926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 860/1742] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:17.059809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 883/1743] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:16 2022] POST /identity/v3/projects => generated 361 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:17.063853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:17.086871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae3e3-2d5e-450c-97af-668a6c14818a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:17.254283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:17.255294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:17.255727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:17.259646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:17.260531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:17.262537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:17.466616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 861/1744] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:17 2022] POST /identity/v3/users => generated 287 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:17.470430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:17.518720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16bd95-b836-4ee5-86e2-5a3fc651aae4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:17.538339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:17.539044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:17.540713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:17.541035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:17.541805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:17.550855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:17.581620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 884/1745] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:17.586343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:17.608341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40e19-db7e-4a16-84ed-f9ed01d295ea admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:17.612084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:17.636589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:17.638328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:17.638869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:17.639396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] PATH_INFO: `/v3/projects/e1595b3247b744389406fde3f10ed67c/users/0b7f4c721b42480fb73785ff48d39969/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:17.696470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1595b3247b744389406fde3f10ed67c, user_id=0b7f4c721b42480fb73785ff48d39969, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:17.715470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:17.877669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:17.880888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:17.912316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:17.924812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 862/1746] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:17 2022] PUT /identity/v3/projects/e1595b3247b744389406fde3f10ed67c/users/0b7f4c721b42480fb73785ff48d39969/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:17.936954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:18.174574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3a77d-bdd6-44c2-a6a8-c00328181ddc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:18.282108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84473994-966b-4f3a-906c-3d8198dfe5d0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:18.306299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:18.311270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:18.312450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:18.312909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:18.314102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:18.316805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:18.361816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 863/1747] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:18.370518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:18.405816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2128e16-8843-42a7-b50e-40bce8676381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:18.406587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2128e16-8843-42a7-b50e-40bce8676381 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:18.411680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2128e16-8843-42a7-b50e-40bce8676381 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:18.412148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2128e16-8843-42a7-b50e-40bce8676381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:18.421733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36214ea-0699-4e61-9ea1-5654447fce58 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:18.436549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:18.440148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:18.443547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:18.444080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] PATH_INFO: `/v3/projects/e1595b3247b744389406fde3f10ed67c/users/0b7f4c721b42480fb73785ff48d39969/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:18.444944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2128e16-8843-42a7-b50e-40bce8676381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:18.446696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2128e16-8843-42a7-b50e-40bce8676381 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:18.450637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1595b3247b744389406fde3f10ed67c, user_id=0b7f4c721b42480fb73785ff48d39969, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:18.461144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:18.467007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 885/1748] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:18.477911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 864/1749] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:18 2022] PUT /identity/v3/projects/e1595b3247b744389406fde3f10ed67c/users/0b7f4c721b42480fb73785ff48d39969/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:18.488928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946e03-41a7-452a-8cb4-749f342ad07a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:18.494829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946e03-41a7-452a-8cb4-749f342ad07a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:18.500486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946e03-41a7-452a-8cb4-749f342ad07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:18.668425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-37946e03-41a7-452a-8cb4-749f342ad07a None None] MFA Rules not processed for user `0b7f4c721b42480fb73785ff48d39969`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:18.669807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-37946e03-41a7-452a-8cb4-749f342ad07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:18.988037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 886/1750] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:19.007760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:19.011334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:19.234659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880ba8-b548-4f65-8df5-146a7facbf86 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:19.254673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:19.259223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:19.259533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:19.263406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:19.328138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:19.336144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:19.398230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 865/1751] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:19.491412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:19.491969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:19.501368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:19.604316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] MFA Rules not processed for user `b071201e9357449baec7ba338ff19ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:19.615381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:19.776658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:19.847858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 887/1752] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:20.295300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:20.298744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:20.328497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb1b2-b333-40dd-b641-1aed50179425 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:20.335125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:20.336441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:20.336924 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:20.337393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:20.342371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:20.394124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:20.480165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:20.483640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88142a6-d9fd-4038-9173-eabe50bc1acd service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:20.525180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 866/1753] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:21.147658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:21.513400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:21.620156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e663036-75fc-4139-acb2-4d31dacf2992 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:21.626403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:21.626857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:21.627179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:21.627667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] PATH_INFO: `/v3/users/3f68e81f80e34f9cac9cb0da50d77ac8` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:21.630916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f68e81f80e34f9cac9cb0da50d77ac8)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:21.633705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:21.921290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f68e81f80e34f9cac9cb0da50d77ac8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:21.922315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f68e81f80e34f9cac9cb0da50d77ac8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:21.923125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f68e81f80e34f9cac9cb0da50d77ac8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:21.947745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f68e81f80e34f9cac9cb0da50d77ac8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:21.978047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f68e81f80e34f9cac9cb0da50d77ac8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:22.068047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 888/1754] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:21 2022] DELETE /identity/v3/users/3f68e81f80e34f9cac9cb0da50d77ac8 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:22.072345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd40e4d-6da0-4184-9d41-d65571f43326 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:22.073058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd40e4d-6da0-4184-9d41-d65571f43326 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:22.073058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd40e4d-6da0-4184-9d41-d65571f43326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:22.120273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:22.126059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bcd40e4d-6da0-4184-9d41-d65571f43326 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:22.129710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bcd40e4d-6da0-4184-9d41-d65571f43326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:22.242218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 867/1755] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:22.253550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:22.255570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:22.396244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85487e-c9dc-4503-968a-8111df3170d3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:22.403528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d3bf-27b4-4682-974a-bc292182ee35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:22.404435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d3bf-27b4-4682-974a-bc292182ee35 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:22.404877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d3bf-27b4-4682-974a-bc292182ee35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:22.405165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d3bf-27b4-4682-974a-bc292182ee35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:22.417708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d3bf-27b4-4682-974a-bc292182ee35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:22.418174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d3bf-27b4-4682-974a-bc292182ee35 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:22.467794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 889/1756] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:22.772355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:23.840645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:23.874289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f12e-c9ac-445d-8adf-96b7dd273e29 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:23.874816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f12e-c9ac-445d-8adf-96b7dd273e29 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:23.875291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f12e-c9ac-445d-8adf-96b7dd273e29 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:23.877651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 868/1757] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:45:23.930830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0966cd-5882-4435-ba21-024c1d0e395d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:23.931339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0966cd-5882-4435-ba21-024c1d0e395d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:23.931505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0966cd-5882-4435-ba21-024c1d0e395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:23.968851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4a0966cd-5882-4435-ba21-024c1d0e395d None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:23.974515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4a0966cd-5882-4435-ba21-024c1d0e395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:24.138521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 890/1758] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:24.337779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f12e-c9ac-445d-8adf-96b7dd273e29 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:24.339696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0820f12e-c9ac-445d-8adf-96b7dd273e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:24.350096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c82add-3fe1-4f02-a51d-caa554db07fc None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:24.350384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c82add-3fe1-4f02-a51d-caa554db07fc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:24.350664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c82add-3fe1-4f02-a51d-caa554db07fc None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:24.352344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 891/1759] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:45:24.373607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f12e-c9ac-445d-8adf-96b7dd273e29 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:24.381445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:24.382126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:24.382416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:24.382865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:24.395048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:24.396985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:24.397278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:24.397568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:24.397850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:24.411216 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 869/1760] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:24.418253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:24.457963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:24.457963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:24.668663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 892/1761] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:24.722075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:24.724452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:24.758163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e75dc-2d94-407c-9113-52546647ab8c service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:24.769992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:24.782870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:24.782870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:24.782870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:24.782870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:24.782870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:24.836488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 870/1762] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:25.270216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:25.273711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:25.291855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3586a-41de-40e9-8750-9ddd41830d38 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:25.303913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:25.305576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:25.306016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:25.306438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] PATH_INFO: `/v3/projects/00dde74441554affb2d818c43dd005f1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:25.321216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00dde74441554affb2d818c43dd005f1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:25.327300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:25.564110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00dde74441554affb2d818c43dd005f1', 'request_id': 'req-5c381788-9986-4915-b80f-c2d494c84336'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:25.686100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00dde74441554affb2d818c43dd005f1', 'request_id': 'req-5c381788-9986-4915-b80f-c2d494c84336'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:25.714467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00dde74441554affb2d818c43dd005f1', 'request_id': 'req-5c381788-9986-4915-b80f-c2d494c84336'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:25.748187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] The token cache is being invalidate because project 00dde74441554affb2d818c43dd005f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:25.748827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:25.749765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:25.753031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 893/1763] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:25 2022] DELETE /identity/v3/projects/00dde74441554affb2d818c43dd005f1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:25.756920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:25.770564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1e5e-64b7-41f5-9245-36a83eeb279d service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:25.858326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:25.859794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:25.860311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:25.861354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] PATH_INFO: `/v3/users/0b7f4c721b42480fb73785ff48d39969` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:25.863181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7f4c721b42480fb73785ff48d39969)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:25.866289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:25.977086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:26.131408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7f4c721b42480fb73785ff48d39969'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:26.216031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7f4c721b42480fb73785ff48d39969'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:26.219408 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7f4c721b42480fb73785ff48d39969'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:26.259588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7f4c721b42480fb73785ff48d39969'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:26.272917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7f4c721b42480fb73785ff48d39969'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:26.303938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 871/1764] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:25 2022] DELETE /identity/v3/users/0b7f4c721b42480fb73785ff48d39969 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:26.499438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:26.501080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:26.517665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c381788-9986-4915-b80f-c2d494c84336 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:26.594394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:26.610705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:26.612806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:26.660727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:26.661519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:26.661982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:26.662549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] PATH_INFO: `/v3/users/e435905850c14349ba57f7a2cb3e5955` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:26.664459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e435905850c14349ba57f7a2cb3e5955)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:26.666809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:26.725525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a94ee-e987-454c-bbe9-b2324af73ee1 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:26.742347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:26.742347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:26.742347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:26.742347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] PATH_INFO: `/v3/users/0c0110bcb6194924860d8b8d38d914e4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:26.742706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0110bcb6194924860d8b8d38d914e4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:26.742706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:27.049730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e435905850c14349ba57f7a2cb3e5955'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.050398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e435905850c14349ba57f7a2cb3e5955'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.051008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e435905850c14349ba57f7a2cb3e5955'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.064615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e435905850c14349ba57f7a2cb3e5955'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.072405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e435905850c14349ba57f7a2cb3e5955'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.110421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0110bcb6194924860d8b8d38d914e4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.249455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 894/1765] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:26 2022] DELETE /identity/v3/users/e435905850c14349ba57f7a2cb3e5955 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:27.249850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:27.251469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:27.345023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7db7-854b-4501-8c1c-aa5147b56cf9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:27.352095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:27.353142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.353433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.353767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] PATH_INFO: `/v3/projects/e1595b3247b744389406fde3f10ed67c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.355005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1595b3247b744389406fde3f10ed67c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:27.360913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:27.377049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0110bcb6194924860d8b8d38d914e4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.377588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0110bcb6194924860d8b8d38d914e4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.415017 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0110bcb6194924860d8b8d38d914e4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.425653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-79da9be2-328e-4ac4-80e3-4a24a4c9a5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0110bcb6194924860d8b8d38d914e4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.433944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 872/1766] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:26 2022] DELETE /identity/v3/users/0c0110bcb6194924860d8b8d38d914e4 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:27.438192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.438484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.438848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.468089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:27.469584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:27.533841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1595b3247b744389406fde3f10ed67c', 'request_id': 'req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.548242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 873/1767] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:27.566899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:27.568362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:27.631880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6c6c-c45f-4ca3-84a9-cb9517fa6bd7 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:27.646121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1595b3247b744389406fde3f10ed67c', 'request_id': 'req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.659484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1595b3247b744389406fde3f10ed67c', 'request_id': 'req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.691196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] The token cache is being invalidate because project e1595b3247b744389406fde3f10ed67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:27.691518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.692845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b7d97e60-633f-411b-9b4d-1a5e396b0e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:27.698570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 895/1768] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:27 2022] DELETE /identity/v3/projects/e1595b3247b744389406fde3f10ed67c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:27.700047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.700522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.700984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.711005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:27.711764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.712051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.712412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.714186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:27.724122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:27.725566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:27.781433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:27.782892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5ed9-9583-4e19-b3ae-b795051bf887 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:27.794529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 874/1769] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:27.807253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 896/1770] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:27.812360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.812710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.813046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.833623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:27.834845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:27.846876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 875/1771] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:27.849036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:27.859285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0267a1-bb28-4b68-94ea-275f639a6b16 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:27.865312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:27.867319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.867923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.868618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.869793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:27.870275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:27.872108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:27.889425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 897/1772] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:27.894597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:27.904520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aea3c8-aec0-4cd0-8696-577213b7b2b9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:27.909837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:27.910521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:27.910983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:27.911331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:27.912047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:27.913979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.022646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.026318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:28.057566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96aea-b984-467b-9506-fdf372e58587 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:28.069999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:28.074275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:28.074703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:28.075183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] PATH_INFO: `/v3/projects/8c727ae950224e02b19794d03c5bdf1e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:28.076651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c727ae950224e02b19794d03c5bdf1e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:28.080873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.088366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 876/1773] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:27 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:28.092843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.155615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:28.237452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28dbf3-af8e-41c8-a890-302bc57a3502 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:28.251897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c727ae950224e02b19794d03c5bdf1e', 'request_id': 'req-ee78d60d-8e25-4981-bd4c-c3403b286d53'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.322967 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:28.325124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:28.325124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:28.325500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:28.326638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:28.329299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.336228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c727ae950224e02b19794d03c5bdf1e', 'request_id': 'req-ee78d60d-8e25-4981-bd4c-c3403b286d53'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.353282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c727ae950224e02b19794d03c5bdf1e', 'request_id': 'req-ee78d60d-8e25-4981-bd4c-c3403b286d53'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.374440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] The token cache is being invalidate because project 8c727ae950224e02b19794d03c5bdf1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:28.376446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.378299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.380930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 898/1774] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:28 2022] DELETE /identity/v3/projects/8c727ae950224e02b19794d03c5bdf1e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:28.386392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.388887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:28.407372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78d60d-8e25-4981-bd4c-c3403b286d53 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:28.414696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:28.416444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:28.416444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:28.416444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] PATH_INFO: `/v3/users/b071201e9357449baec7ba338ff19ac1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:28.418766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b071201e9357449baec7ba338ff19ac1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:28.421070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.477374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 877/1775] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:28 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:28.478611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.481616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:28.514796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34708ea-b614-4e0f-a99a-0649deb01570 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:28.537039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:28.541489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:28.541489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:28.541489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:28.541489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:28.541489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.568184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 878/1776] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:28.579362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.591791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb04969-fda4-473f-8344-11fd0a512431 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:28.599195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:28.604744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:28.604744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:28.604744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:28.604744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:28.604744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.631638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 879/1777] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:28.632976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.635644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:28.658782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d032fd-cbfc-4d24-9339-260f1b01262e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:28.671674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:28.674577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:28.676550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:28.677037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] PATH_INFO: `/v3/projects/d8a81ec3a09447daa53c4c0e47913f46` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:28.678831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b071201e9357449baec7ba338ff19ac1'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.679966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a81ec3a09447daa53c4c0e47913f46)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:28.680386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b071201e9357449baec7ba338ff19ac1'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.683020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:28.692703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b071201e9357449baec7ba338ff19ac1'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.741395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b071201e9357449baec7ba338ff19ac1'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.761089 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b071201e9357449baec7ba338ff19ac1'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.910101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 899/1778] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:28 2022] DELETE /identity/v3/users/b071201e9357449baec7ba338ff19ac1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:28.912229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:28.914174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:28.938312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a81ec3a09447daa53c4c0e47913f46', 'request_id': 'req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.955470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a81ec3a09447daa53c4c0e47913f46', 'request_id': 'req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:28.970077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a81ec3a09447daa53c4c0e47913f46', 'request_id': 'req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.031526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c82ae5-d328-438a-a8ba-eb6dc5293834 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.038415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deabee0-2637-4650-a334-297096edadd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.039670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deabee0-2637-4650-a334-297096edadd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.044191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deabee0-2637-4650-a334-297096edadd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.044191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deabee0-2637-4650-a334-297096edadd8 admin admin] PATH_INFO: `/v3/projects/1f8cb75a454e4075acfdb6e7b6b9fcc4/users/c5370aa32b924fbf95b2a9577f05f3aa/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.068061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deabee0-2637-4650-a334-297096edadd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8cb75a454e4075acfdb6e7b6b9fcc4, user_id=c5370aa32b924fbf95b2a9577f05f3aa, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.068649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] The token cache is being invalidate because project d8a81ec3a09447daa53c4c0e47913f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:29.068944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.069599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.072240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deabee0-2637-4650-a334-297096edadd8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:29.075641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 880/1779] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:28 2022] DELETE /identity/v3/projects/d8a81ec3a09447daa53c4c0e47913f46 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:29.077046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:29.080132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.160742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdf9b-d895-46e9-baf7-f792e2daaf81 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.165556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.166874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.167198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.167490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] PATH_INFO: `/v3/users/086042278a1346a4b78524e2dfb2cc5e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.169114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086042278a1346a4b78524e2dfb2cc5e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.171060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:29.210365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 900/1780] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:28 2022] PUT /identity/v3/projects/1f8cb75a454e4075acfdb6e7b6b9fcc4/users/c5370aa32b924fbf95b2a9577f05f3aa/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:29.223650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.223909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.224287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.255040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] MFA Rules not processed for user `c5370aa32b924fbf95b2a9577f05f3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:29.256447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.321738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 901/1781] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:29.322782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:29.326073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.376195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086042278a1346a4b78524e2dfb2cc5e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.395154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779b0fe-c7d5-4bb5-867a-7acacf049ae2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.399695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.400559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.400872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.401151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] PATH_INFO: `/v3/projects/54fc91fb58bc4ee683eb0fcd79e0708c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.402340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fc91fb58bc4ee683eb0fcd79e0708c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.404346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:29.495906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086042278a1346a4b78524e2dfb2cc5e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.496607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086042278a1346a4b78524e2dfb2cc5e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.509965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086042278a1346a4b78524e2dfb2cc5e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.517221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086042278a1346a4b78524e2dfb2cc5e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.526260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 881/1782] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:29 2022] DELETE /identity/v3/users/086042278a1346a4b78524e2dfb2cc5e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:29.527037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:29.528486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.580732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fc91fb58bc4ee683eb0fcd79e0708c', 'request_id': 'req-12b41872-ba7f-4896-bf68-39b5034086a7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.622479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2da3-9fec-4e8d-81e8-117cfe524ce5 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.645869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fc91fb58bc4ee683eb0fcd79e0708c', 'request_id': 'req-12b41872-ba7f-4896-bf68-39b5034086a7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.667760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fc91fb58bc4ee683eb0fcd79e0708c', 'request_id': 'req-12b41872-ba7f-4896-bf68-39b5034086a7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.683406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] The token cache is being invalidate because project 54fc91fb58bc4ee683eb0fcd79e0708c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:29.684922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.685860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-12b41872-ba7f-4896-bf68-39b5034086a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:29.688149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 902/1783] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:29 2022] DELETE /identity/v3/projects/54fc91fb58bc4ee683eb0fcd79e0708c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:29.695755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec5fe-9914-4661-9a0e-af1b10835575 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.696295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec5fe-9914-4661-9a0e-af1b10835575 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.696720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec5fe-9914-4661-9a0e-af1b10835575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.700382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.701061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.701351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.701761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.702489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.704481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:29.716847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a96ec5fe-9914-4661-9a0e-af1b10835575 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:29.718112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a96ec5fe-9914-4661-9a0e-af1b10835575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.726738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 903/1784] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:29.739717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.740002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.740280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.760569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:29.761787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.770532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 904/1785] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:29.775234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:29.788828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b87745-f101-420b-b69a-b8b0e388f3d4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.790032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.793370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.793370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.793370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.793370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:29.793370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.794681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:29.808884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 905/1786] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:45:29.811723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:29.813520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:29.829181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166067d6-475e-4f8b-834f-76d2d25eb4ea admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.834011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.834693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.834979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.835288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.835994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.837936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:29.859519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 882/1787] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:29 2022] POST /identity/v3/projects => generated 379 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:29.865885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:29.868723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:29.941680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28004-2b4d-43e1-b3ad-77fb239392bd admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:29.947187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:29.947887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:29.948180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:29.948481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:29.949179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:29.951205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:30.679351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 906/1788] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:29 2022] POST /identity/v3/projects => generated 371 bytes in 863 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:30.680351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:30.736904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 883/1789] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:29 2022] POST /identity/v3/users => generated 290 bytes in 872 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:30.740544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:30.754057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910c6c1-e9f3-4f28-8c23-41cc2a246f57 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:30.771162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176604a-bc33-4bf7-9224-bb120f8d8e78 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:30.789759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:30.789759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:30.789759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:30.789759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:30.790728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:30.798703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:30.856220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:30.856935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:30.857223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:30.857516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:30.858247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:30.859940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:30.874969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 884/1790] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:30.876174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:30.878654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:30.896169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d798-30de-41a0-bb63-01dc0de0449d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:30.903463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:30.904176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:30.904445 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:30.904730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] PATH_INFO: `/v3/projects/9375dc4592e14317896f0d538043cbf2` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:30.906046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9375dc4592e14317896f0d538043cbf2)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:30.908057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:30.942660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 907/1791] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:30 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:30.944794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:30.954582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307b0d0-a47a-4a64-8af3-640548026bf9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:30.960003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:30.960286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:30.960578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:30.960859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:30.961601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:30.963278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:30.974515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 908/1792] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:30.976987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:30.987195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3d84-aba6-4e43-9d16-47eb7ebd0a0b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:30.992268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:30.993254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:30.993533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:30.993818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:30.994838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:30.996587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.013899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 909/1793] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:31.013899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.016801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9375dc4592e14317896f0d538043cbf2', 'request_id': 'req-6d2e7e0f-bcc1-4337-907e-abeeeb089618'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.021868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02be6-c677-41a1-aa4d-c9960c4ef155 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.022834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9375dc4592e14317896f0d538043cbf2', 'request_id': 'req-6d2e7e0f-bcc1-4337-907e-abeeeb089618'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.032093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9375dc4592e14317896f0d538043cbf2', 'request_id': 'req-6d2e7e0f-bcc1-4337-907e-abeeeb089618'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.082922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.083886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.084171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.084452 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] PATH_INFO: `/v3/projects/8bc9450c814740b18b99f9baae827b78/users/80dd4612860a4f93a634d765d5d64634/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.100425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc9450c814740b18b99f9baae827b78, user_id=80dd4612860a4f93a634d765d5d64634, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.103764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.137112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] The token cache is being invalidate because project 9375dc4592e14317896f0d538043cbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:31.137404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.138130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.140751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 885/1794] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:30 2022] DELETE /identity/v3/projects/9375dc4592e14317896f0d538043cbf2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:31.140884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.142810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:31.156965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7e0f-bcc1-4337-907e-abeeeb089618 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.164102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.164808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.165098 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.165378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.166122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.167989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.179579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 886/1795] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:31.180774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.184258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:31.203246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282648-b6e5-4e28-a491-1f5ea3ffa20d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.208280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.209175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.209462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.209746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] PATH_INFO: `/v3/users/6655f2e3083d4598b044b5f679eb71a3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.211014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6655f2e3083d4598b044b5f679eb71a3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.212975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.233767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 910/1796] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:31 2022] PUT /identity/v3/projects/8bc9450c814740b18b99f9baae827b78/users/80dd4612860a4f93a634d765d5d64634/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:31.245765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.327545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc6bd5-96d7-4e00-a5eb-41010c7f674c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.332510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837847-c25a-42a3-8647-c201bd021f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.333356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837847-c25a-42a3-8647-c201bd021f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.333644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837847-c25a-42a3-8647-c201bd021f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.333921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837847-c25a-42a3-8647-c201bd021f7c admin admin] PATH_INFO: `/v3/projects/0874819dec4144c3b356951f12474adb/users/dcfc9eea64ab4a639a2bf144b583e4e3/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.352244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837847-c25a-42a3-8647-c201bd021f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874819dec4144c3b356951f12474adb, user_id=dcfc9eea64ab4a639a2bf144b583e4e3, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.355020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837847-c25a-42a3-8647-c201bd021f7c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.504259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 911/1797] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:31 2022] PUT /identity/v3/projects/0874819dec4144c3b356951f12474adb/users/dcfc9eea64ab4a639a2bf144b583e4e3/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:31.505842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b542-2f59-4508-8f4f-cd97529f23e6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.506608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b542-2f59-4508-8f4f-cd97529f23e6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.506882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b542-2f59-4508-8f4f-cd97529f23e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.513067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6655f2e3083d4598b044b5f679eb71a3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.535716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e6a4b542-2f59-4508-8f4f-cd97529f23e6 None None] MFA Rules not processed for user `80dd4612860a4f93a634d765d5d64634`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:31.537451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e6a4b542-2f59-4508-8f4f-cd97529f23e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:31.594030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6655f2e3083d4598b044b5f679eb71a3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.594908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6655f2e3083d4598b044b5f679eb71a3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.604639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 912/1798] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:31.606155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791954-fd87-4a65-bb50-519275856437 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.606455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791954-fd87-4a65-bb50-519275856437 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.606737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0791954-fd87-4a65-bb50-519275856437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.608374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6655f2e3083d4598b044b5f679eb71a3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.615543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6655f2e3083d4598b044b5f679eb71a3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:31.621946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 887/1799] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:31 2022] DELETE /identity/v3/users/6655f2e3083d4598b044b5f679eb71a3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:31.625682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.627914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:31.636658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e0791954-fd87-4a65-bb50-519275856437 None None] MFA Rules not processed for user `dcfc9eea64ab4a639a2bf144b583e4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:31.637873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e0791954-fd87-4a65-bb50-519275856437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:31.696460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0edd5a-3256-4499-8e2e-e9f65b7a6a67 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.701561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.702383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.702785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.703202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.704030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.706126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.711839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 913/1800] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:31.716332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791954-fd87-4a65-bb50-519275856437 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.718861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e0791954-fd87-4a65-bb50-519275856437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:31.732629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0791954-fd87-4a65-bb50-519275856437 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.737739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.738389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.738711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.738972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.739700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.741694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.849529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 888/1801] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:31 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:31.850603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.862138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 914/1802] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:31 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:31.866238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:31.926417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8237c-8d2a-4120-8467-b563e3f813de admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.942602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400b44a-621d-4a9e-bcf7-9b37fe91f59a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:31.948869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.949555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.949838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.950110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.950807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.954003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:31.971983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:31.972690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:31.973721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:31.974015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:31.974730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:31.976718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.065669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 915/1803] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:31 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:32.065669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.066882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.083589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5de9-848c-4aa0-898f-028f8bbcdb05 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.088856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.089848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.093446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.093446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] PATH_INFO: `/v3/users/fd81ed2a866a4e0e8ef9c5088ed5a432` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.093446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd81ed2a866a4e0e8ef9c5088ed5a432)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.094165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.120350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 889/1804] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:31 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:32.121559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.139140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ff1e2-ca5d-4f50-90fb-9c8a4a5a0fb3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.146457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.147528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.148320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.148751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.149641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.158592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.178575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 890/1805] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:32.179593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.195364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06deaf-5acc-49ce-a10e-acf00b1ca396 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.203581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.204422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.204782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.205203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.206094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.208052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.220044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 891/1806] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:32.221441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.224813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.237671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:32.243487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478a50c-8347-49be-9b9d-84414aa72af4 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.249771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.250645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.250929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.251323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] PATH_INFO: `/v3/projects/928ce8122cad4853962beaa857efdc40` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.252562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928ce8122cad4853962beaa857efdc40)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.254467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.293335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd81ed2a866a4e0e8ef9c5088ed5a432'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.294317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd81ed2a866a4e0e8ef9c5088ed5a432'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.294934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd81ed2a866a4e0e8ef9c5088ed5a432'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.308141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd81ed2a866a4e0e8ef9c5088ed5a432'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.315065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd81ed2a866a4e0e8ef9c5088ed5a432'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.384606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928ce8122cad4853962beaa857efdc40', 'request_id': 'req-10ea671c-5275-4dc9-9643-07d3ea40fc66'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.391034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928ce8122cad4853962beaa857efdc40', 'request_id': 'req-10ea671c-5275-4dc9-9643-07d3ea40fc66'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.401003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 916/1807] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:32 2022] DELETE /identity/v3/users/fd81ed2a866a4e0e8ef9c5088ed5a432 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:32.402119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.404917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.414183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928ce8122cad4853962beaa857efdc40', 'request_id': 'req-10ea671c-5275-4dc9-9643-07d3ea40fc66'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.498628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d750-e5cd-4c4d-a7f8-75225e97c69f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.504151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3421a1-62c7-4cf9-b5ec-f257050afb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.505209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3421a1-62c7-4cf9-b5ec-f257050afb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.505623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3421a1-62c7-4cf9-b5ec-f257050afb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.507389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3421a1-62c7-4cf9-b5ec-f257050afb48 admin admin] PATH_INFO: `/v3/projects/a63e53401dd54c019c08a08facc90afa/users/c5051de01f8a42649dd73c2cd95e9686/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.515017 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] The token cache is being invalidate because project 928ce8122cad4853962beaa857efdc40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:32.515556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.516389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:32.519286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 892/1808] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:32 2022] DELETE /identity/v3/projects/928ce8122cad4853962beaa857efdc40 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:32.531178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.532537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.532846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3421a1-62c7-4cf9-b5ec-f257050afb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63e53401dd54c019c08a08facc90afa, user_id=c5051de01f8a42649dd73c2cd95e9686, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.536844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3421a1-62c7-4cf9-b5ec-f257050afb48 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.629077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 917/1809] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:32 2022] PUT /identity/v3/projects/a63e53401dd54c019c08a08facc90afa/users/c5051de01f8a42649dd73c2cd95e9686/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:32.630395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ee57f-9419-4de6-ad59-1c5d5478faa6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.630683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ee57f-9419-4de6-ad59-1c5d5478faa6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.630960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ee57f-9419-4de6-ad59-1c5d5478faa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.632573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea671c-5275-4dc9-9643-07d3ea40fc66 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.666112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e43ee57f-9419-4de6-ad59-1c5d5478faa6 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:32.667770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e43ee57f-9419-4de6-ad59-1c5d5478faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.728685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b884586-61aa-4b7f-94ce-5de6f800f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.729739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884586-61aa-4b7f-94ce-5de6f800f551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.730032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884586-61aa-4b7f-94ce-5de6f800f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.730305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884586-61aa-4b7f-94ce-5de6f800f551 admin admin] PATH_INFO: `/v3/projects/b3b2935ce1cc4585bc5f7eeefb9d3d86/users/59933b0f44ce44109dc3f391f56e74d2/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.757519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b884586-61aa-4b7f-94ce-5de6f800f551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b2935ce1cc4585bc5f7eeefb9d3d86, user_id=59933b0f44ce44109dc3f391f56e74d2, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.757519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b884586-61aa-4b7f-94ce-5de6f800f551 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.769346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 918/1810] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:32.771435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.771986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.772471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.792511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:32.793814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.802307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 919/1811] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:32.803247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.806751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.820687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dfe73-4cb5-41b1-9319-637ceefaf536 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.825565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.826245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.826560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.826840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.827683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:32.829307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:32.840382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 920/1812] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:32.841249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:32.842957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.897814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 893/1813] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:32 2022] PUT /identity/v3/projects/b3b2935ce1cc4585bc5f7eeefb9d3d86/users/59933b0f44ce44109dc3f391f56e74d2/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:32.901174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:32.901640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:32.902036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:32.913427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1a82b-5c6f-48be-93a0-3e125c75f784 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:32.926427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:32.927960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:32.998419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:32.999187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.000083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.000209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.015233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 894/1814] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:33.016248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.029403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ba207-fc76-4aa7-a33e-bc388616e0c9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.038485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.040056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.040474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.041069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] PATH_INFO: `/v3/projects/a63e53401dd54c019c08a08facc90afa/users/c5051de01f8a42649dd73c2cd95e9686/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.044573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63e53401dd54c019c08a08facc90afa, user_id=c5051de01f8a42649dd73c2cd95e9686, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.050602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.087540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.088582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.092488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 895/1815] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:33 2022] PUT /identity/v3/projects/a63e53401dd54c019c08a08facc90afa/users/c5051de01f8a42649dd73c2cd95e9686/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:33.094425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.121744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 921/1816] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:33.124305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.153425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4110e4-a064-4a38-878e-d91461ef78d9 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.213949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529719c9-13c1-45db-9007-6b3027ba2772 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.220924 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc800cc-5f80-48ee-85b8-8da94159d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.222351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc800cc-5f80-48ee-85b8-8da94159d083 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.222715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc800cc-5f80-48ee-85b8-8da94159d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.223068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc800cc-5f80-48ee-85b8-8da94159d083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.224516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc800cc-5f80-48ee-85b8-8da94159d083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.226261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc800cc-5f80-48ee-85b8-8da94159d083 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.260419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 896/1817] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:33.262190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee09a2-358f-4578-9b91-874ba6a7fa46 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.262746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee09a2-358f-4578-9b91-874ba6a7fa46 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.263336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee09a2-358f-4578-9b91-874ba6a7fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.266386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:33.270767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.274308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.274308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.276530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.277527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:33.277850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.282111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.299539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-49ee09a2-358f-4578-9b91-874ba6a7fa46 None None] MFA Rules not processed for user `c5051de01f8a42649dd73c2cd95e9686`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:33.301115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-49ee09a2-358f-4578-9b91-874ba6a7fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:33.331929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 922/1818] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:33.334878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.353249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920254-a245-4464-b7f5-d30292768be1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.363832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.365696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.366146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.366967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] PATH_INFO: `/v3/projects/b3b2935ce1cc4585bc5f7eeefb9d3d86/users/59933b0f44ce44109dc3f391f56e74d2/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.371360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b2935ce1cc4585bc5f7eeefb9d3d86, user_id=59933b0f44ce44109dc3f391f56e74d2, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.376057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.403180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 923/1819] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:33 2022] PUT /identity/v3/projects/b3b2935ce1cc4585bc5f7eeefb9d3d86/users/59933b0f44ce44109dc3f391f56e74d2/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:33.403180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.423515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 897/1820] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:33.425885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.426245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.426412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.465530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] MFA Rules not processed for user `59933b0f44ce44109dc3f391f56e74d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:33.466980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:33.499646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292af434-1b43-42ee-a6e9-2395e83a4f9a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.507148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.508224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.509590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.509590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.510132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.512562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.606818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 898/1821] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:33.608372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.612816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:33.638769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 924/1822] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:33 2022] POST /identity/v3/projects => generated 389 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:33.641557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.649452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:33.652648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:33.733393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420c70-75a8-4274-af74-562fc01ff016 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.740155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.741557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.742173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.742291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.758018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26bf90-7102-4849-9566-6cce6c3988f7 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.766957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c518a5-d84f-42fa-bbe5-c568aeb11a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.768113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c518a5-d84f-42fa-bbe5-c568aeb11a41 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.768953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c518a5-d84f-42fa-bbe5-c568aeb11a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.769251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c518a5-d84f-42fa-bbe5-c568aeb11a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.838978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.841689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.858792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 925/1823] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:33.860215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:33.880979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c518a5-d84f-42fa-bbe5-c568aeb11a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.882775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c518a5-d84f-42fa-bbe5-c568aeb11a41 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:33.897674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 899/1824] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:33.899712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387413c3-bda4-4475-9b36-48f0fb7c8014 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.900853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387413c3-bda4-4475-9b36-48f0fb7c8014 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.901344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387413c3-bda4-4475-9b36-48f0fb7c8014 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.904448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 900/1825] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:45:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:45:33.916360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.917252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.917796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.938681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47028110-9229-4f95-8263-6571b08e6d72 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:33.944501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:33.945225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:33.945373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:33.945681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:33.946183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:33.946999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:33.947692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:33.949183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.054009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 926/1826] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:33 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:34.054009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.074849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737ef4-3138-4db1-8b72-6092b5899f12 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.088678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.089356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.089704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.089983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.092953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:34.096028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 901/1827] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:34.096935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.108435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de9f0-2be7-485a-bb83-a63c1ac1ab95 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.116725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.118311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.118610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.118897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.121383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.123260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.139378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 902/1828] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:34.140794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.151969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4924b2-acf2-4b59-93cc-b8e15dd9da74 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.157772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.158662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.159069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.159480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.160314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.162263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.182164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 903/1829] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:34.186391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.203356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.206649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.213565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6ca9f-a116-4608-b14c-a529db231679 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.222917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184316d-ac1f-4f94-81c3-b0b7b8d98f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.227988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184316d-ac1f-4f94-81c3-b0b7b8d98f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.228303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184316d-ac1f-4f94-81c3-b0b7b8d98f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.228592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184316d-ac1f-4f94-81c3-b0b7b8d98f39 admin admin] PATH_INFO: `/v3/projects/ad88e862aa614d0c9f082f0c2b905ea7/users/52784340415349eea22dd1a2a89a2c69/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.230195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 927/1830] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:34.230886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.254315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce5c7d-e134-4ac0-8352-204772466394 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.272622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.272622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.272622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.272622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.273239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184316d-ac1f-4f94-81c3-b0b7b8d98f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad88e862aa614d0c9f082f0c2b905ea7, user_id=52784340415349eea22dd1a2a89a2c69, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.278917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184316d-ac1f-4f94-81c3-b0b7b8d98f39 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.281319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:34.390554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 904/1831] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:34 2022] PUT /identity/v3/projects/ad88e862aa614d0c9f082f0c2b905ea7/users/52784340415349eea22dd1a2a89a2c69/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:34.406499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.406812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.407121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.428556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.435549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.462425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 928/1832] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:34.465642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] MFA Rules not processed for user `52784340415349eea22dd1a2a89a2c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:34.467032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:34.569479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.570992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:34.606625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37c92a-bae5-48de-b321-aa576cf77bda service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.648258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 905/1833] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:34.653037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.724839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.725564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.725856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.726163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.738825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.740508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.748811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47f8ef-97b3-4f85-bac3-f0fdb953cc97 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:34.754560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:34.755304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:34.755588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:34.756746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:34.756746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:34.758839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:34.779636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 929/1834] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:34.864174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:34.916521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 906/1835] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:34 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:34.920981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:34.935142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510a444-80fc-4d9a-9ff7-f05b85f7c779 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.012493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.013736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.014229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.014596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.015533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.019465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.090482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.093290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:35.108912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d836-a812-4de5-94fd-6b7dbc628aae admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.114701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.115615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.115967 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.116192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] PATH_INFO: `/v3/projects/eb2d5fbc70f04548b7f66feb51a01419` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.117433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2d5fbc70f04548b7f66feb51a01419)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.119679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.140334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 930/1836] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:34 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:35.141322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.153851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd6e7-fecc-4aaf-8d49-80bf80db1438 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.164424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.164424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.164866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.165211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.166035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.167792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.184201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 931/1837] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:35.188866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.201797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90835d55-afc7-44b3-bc85-87d8514f2f58 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.207181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.208388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.208809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.209190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] PATH_INFO: `/v3/projects/6dc60fe37b424132aa562553686d5eca/users/18271a937b3c49e4979f414df5b34213/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.235211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc60fe37b424132aa562553686d5eca, user_id=18271a937b3c49e4979f414df5b34213, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.241410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.252210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2d5fbc70f04548b7f66feb51a01419', 'request_id': 'req-698ed263-15e2-4806-aad0-4dc6f716e2c0'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:35.258643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2d5fbc70f04548b7f66feb51a01419', 'request_id': 'req-698ed263-15e2-4806-aad0-4dc6f716e2c0'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:35.265781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2d5fbc70f04548b7f66feb51a01419', 'request_id': 'req-698ed263-15e2-4806-aad0-4dc6f716e2c0'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:35.353963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] The token cache is being invalidate because project eb2d5fbc70f04548b7f66feb51a01419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:35.357739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:35.357739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-698ed263-15e2-4806-aad0-4dc6f716e2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:35.357934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 932/1838] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:35 2022] PUT /identity/v3/projects/6dc60fe37b424132aa562553686d5eca/users/18271a937b3c49e4979f414df5b34213/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:35.358024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 907/1839] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:35 2022] DELETE /identity/v3/projects/eb2d5fbc70f04548b7f66feb51a01419 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:35.360294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.362322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf4bdc-f3ec-4d6f-9a6e-fb3626fe7741 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.362615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf4bdc-f3ec-4d6f-9a6e-fb3626fe7741 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.362903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf4bdc-f3ec-4d6f-9a6e-fb3626fe7741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.363032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:35.382412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-cebf4bdc-f3ec-4d6f-9a6e-fb3626fe7741 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:35.386604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cebf4bdc-f3ec-4d6f-9a6e-fb3626fe7741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:35.429525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:35.430732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b13977-d0c1-4d40-af2d-6eaba0b3d582 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.435639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.436318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.436597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.436872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.437611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.439314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.449745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 933/1840] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:35.453822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.455793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 908/1841] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:35.463952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.464248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.464565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.465264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe411fd-2b05-4e11-bf66-41a76e2574bc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.470294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b1f1c-6d70-4a7c-ab79-b49741f2c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.472530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b1f1c-6d70-4a7c-ab79-b49741f2c2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.472530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b1f1c-6d70-4a7c-ab79-b49741f2c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.472530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b1f1c-6d70-4a7c-ab79-b49741f2c2e5 admin admin] PATH_INFO: `/v3/projects/6dc60fe37b424132aa562553686d5eca/users/18271a937b3c49e4979f414df5b34213/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.474810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b1f1c-6d70-4a7c-ab79-b49741f2c2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc60fe37b424132aa562553686d5eca, user_id=18271a937b3c49e4979f414df5b34213, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.478382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b1f1c-6d70-4a7c-ab79-b49741f2c2e5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.489872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:35.490299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 934/1842] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:35 2022] PUT /identity/v3/projects/6dc60fe37b424132aa562553686d5eca/users/18271a937b3c49e4979f414df5b34213/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:35.491127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:35.501163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.501622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.502122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.533889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] MFA Rules not processed for user `18271a937b3c49e4979f414df5b34213`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:35.535180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:35.574654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 909/1843] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:35.578556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.595223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddee661-3491-4db9-9e00-62057b94eb4f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.603774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.605949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.606563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.606992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.608503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:35.609185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.611634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.627896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 910/1844] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:45:35.633101 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.638288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 935/1845] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:35.647462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7ccd9-ea45-4bd9-8ba6-ffc5cb4c9810 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.647886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.649414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:35.652766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.653559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.653914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.654264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.655316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.657312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.723004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74ce0-853c-4df7-b046-bd9b2f75d80c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.727578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.728251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.728535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.728810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.739648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.741186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.752555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 936/1846] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:35.765744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 911/1847] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:35 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:35.770728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.792740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ee966-855e-4bd5-8953-9dea99a37455 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.899297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.900527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.900527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.900875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.901713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.903812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.917995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:35.930167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1356-6621-4b2b-bc74-f64a541deb07 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:35.936705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:35.937857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:35.937857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:35.938131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] PATH_INFO: `/v3/users/52784340415349eea22dd1a2a89a2c69` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:35.939880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52784340415349eea22dd1a2a89a2c69)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:35.941994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:35.995512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 937/1848] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:35 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:35.997576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.008207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3a5af-9f06-42e8-8373-771d6cbb54d1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.012928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.013594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.013880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.014158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.014889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.016589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.033128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 938/1849] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:36.034519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.044929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015449b0-57fb-4c27-9256-cd665c082fa0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.050043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.050602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.050895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.051211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.051959 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.053638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.067429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 939/1850] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:36.071544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.085883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff4f47-1b97-49e0-9ae1-0eeee9aa29d3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.090775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820fcd-8512-43fb-aa19-6139868cb4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.091756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820fcd-8512-43fb-aa19-6139868cb4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.092044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820fcd-8512-43fb-aa19-6139868cb4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.092323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820fcd-8512-43fb-aa19-6139868cb4b4 admin admin] PATH_INFO: `/v3/projects/e7b65ad8e5b649ccad0f871069277c09/users/2b7b75227b7e4d46a6650d6cc257118d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.110888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820fcd-8512-43fb-aa19-6139868cb4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b65ad8e5b649ccad0f871069277c09, user_id=2b7b75227b7e4d46a6650d6cc257118d, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.113814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820fcd-8512-43fb-aa19-6139868cb4b4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.148332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52784340415349eea22dd1a2a89a2c69'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:36.217008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 940/1851] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:36 2022] PUT /identity/v3/projects/e7b65ad8e5b649ccad0f871069277c09/users/2b7b75227b7e4d46a6650d6cc257118d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:36.228609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.228902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.229215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.239533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52784340415349eea22dd1a2a89a2c69'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:36.240406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52784340415349eea22dd1a2a89a2c69'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:36.256650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52784340415349eea22dd1a2a89a2c69'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:36.260103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] MFA Rules not processed for user `2b7b75227b7e4d46a6650d6cc257118d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:36.261645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:36.264299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-92373ac4-6b04-4ecf-a804-4576c13adaf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52784340415349eea22dd1a2a89a2c69'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:36.270686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 912/1852] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:35 2022] DELETE /identity/v3/users/52784340415349eea22dd1a2a89a2c69 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:36.275219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.275515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.275797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.295458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:36.296683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:36.364386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 941/1853] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:36.369912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.373564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:36.395040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 913/1854] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:36.414283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.417173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:36.479995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835f941-2f08-42cf-997c-42fa94560833 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.487786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.488486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.488777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.489059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.489791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.492996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.519711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831333c-4ac7-4a5c-a3a7-8af0e9c79586 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.527253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.528764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.529307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.529845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.546979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.549965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.567015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 914/1855] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:36.590882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 942/1856] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:36 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:36.594725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.605587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6191f5c-c9c5-4934-8cca-a1668cbf61e8 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.692587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.693316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.693601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.693877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.694588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.696675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.783907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 915/1857] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:36 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:36.787915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.800801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b439cbf-aa3b-45b9-9085-a6f2a3ddd659 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.807576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.808741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.808741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.809005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.809646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.811200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.825835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 943/1858] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:36.828323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.838843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352306a-a59b-4c63-86af-c2c48b2b3ad5 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:36.847664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:36.849440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:36.849940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:36.850172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] PATH_INFO: `/v3/projects/28d1bff3961842b98fad747c4206c03e/users/41800d7ab89f44e5b721b7c0c7c1a09f/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:36.874083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d1bff3961842b98fad747c4206c03e, user_id=41800d7ab89f44e5b721b7c0c7c1a09f, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:36.877155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:36.972326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 916/1859] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:36 2022] PUT /identity/v3/projects/28d1bff3961842b98fad747c4206c03e/users/41800d7ab89f44e5b721b7c0c7c1a09f/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:36.976584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:36.986775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e59c99-eb69-49a1-bfb6-1aa7bcbab9a3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:37.054719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:37.055416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.055697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.055969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.056691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:37.058287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:37.066647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:37.069455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 944/1860] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:37.070109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:37.073567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:37.080842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:37.086870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e712c5-8fd7-417f-8191-4128618f1494 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:37.092073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10589adf-d8bf-478d-a502-3aef9e29db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:37.093218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10589adf-d8bf-478d-a502-3aef9e29db4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.093692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10589adf-d8bf-478d-a502-3aef9e29db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.093977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10589adf-d8bf-478d-a502-3aef9e29db4f admin admin] PATH_INFO: `/v3/projects/28d1bff3961842b98fad747c4206c03e/users/41800d7ab89f44e5b721b7c0c7c1a09f/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.096996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10589adf-d8bf-478d-a502-3aef9e29db4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d1bff3961842b98fad747c4206c03e, user_id=41800d7ab89f44e5b721b7c0c7c1a09f, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:37.098454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027c49-7ca5-4749-ad91-e024a2315093 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:37.100140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10589adf-d8bf-478d-a502-3aef9e29db4f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:37.115302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 945/1861] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:37 2022] PUT /identity/v3/projects/28d1bff3961842b98fad747c4206c03e/users/41800d7ab89f44e5b721b7c0c7c1a09f/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:37.115450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:37.116480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.116769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.117054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] PATH_INFO: `/v3/projects/ad88e862aa614d0c9f082f0c2b905ea7` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.122887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.123354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.123634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.137299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad88e862aa614d0c9f082f0c2b905ea7)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:37.149940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:37.155953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] MFA Rules not processed for user `41800d7ab89f44e5b721b7c0c7c1a09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:37.158773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:37.269346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 946/1862] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:37.277824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:37.279477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:37.311440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad88e862aa614d0c9f082f0c2b905ea7', 'request_id': 'req-97078fc2-0010-41ed-bfbd-b526d33231ac'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.320763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad88e862aa614d0c9f082f0c2b905ea7', 'request_id': 'req-97078fc2-0010-41ed-bfbd-b526d33231ac'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.331536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad88e862aa614d0c9f082f0c2b905ea7', 'request_id': 'req-97078fc2-0010-41ed-bfbd-b526d33231ac'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.354896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c039-9d6d-46b6-bbae-49d0018cd516 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:37.418637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:37.419345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.419632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.419910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.422054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] The token cache is being invalidate because project ad88e862aa614d0c9f082f0c2b905ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:37.422347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.423003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.428662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 917/1863] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:37 2022] DELETE /identity/v3/projects/ad88e862aa614d0c9f082f0c2b905ea7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:37.430465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:37.431856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:37.494518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:37.496076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:37.507228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 947/1864] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:37.511630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97078fc2-0010-41ed-bfbd-b526d33231ac admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:37.516571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:37.517526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.518315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.518594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] PATH_INFO: `/v3/users/18271a937b3c49e4979f414df5b34213` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.519862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18271a937b3c49e4979f414df5b34213)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:37.521857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:37.643143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:37.723805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18271a937b3c49e4979f414df5b34213'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.868321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18271a937b3c49e4979f414df5b34213'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.868970 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18271a937b3c49e4979f414df5b34213'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.882765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18271a937b3c49e4979f414df5b34213'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.889460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-539ccc65-3827-46ac-90f0-1615589a5c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18271a937b3c49e4979f414df5b34213'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:37.895593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 918/1865] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:37 2022] DELETE /identity/v3/users/18271a937b3c49e4979f414df5b34213 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:38.431389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:38.445142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa9a74-0478-4b8c-821e-023fcad221d1 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:38.525171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:38.525967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:38.526311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:38.526599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] PATH_INFO: `/v3/projects/6dc60fe37b424132aa562553686d5eca` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:38.527905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc60fe37b424132aa562553686d5eca)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:38.530126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:38.715517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc60fe37b424132aa562553686d5eca', 'request_id': 'req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:38.856360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc60fe37b424132aa562553686d5eca', 'request_id': 'req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:38.864451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc60fe37b424132aa562553686d5eca', 'request_id': 'req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:38.877579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] The token cache is being invalidate because project 6dc60fe37b424132aa562553686d5eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:38.877962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:38.878713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:38.884249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 948/1866] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:38 2022] DELETE /identity/v3/projects/6dc60fe37b424132aa562553686d5eca => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:38.888065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8adba7-21c9-481d-b41b-4f7e4bb7be74 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:38.888552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8adba7-21c9-481d-b41b-4f7e4bb7be74 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:38.888552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8adba7-21c9-481d-b41b-4f7e4bb7be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:38.916912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:38.916912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:38.919953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4f8adba7-21c9-481d-b41b-4f7e4bb7be74 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:38.921239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4f8adba7-21c9-481d-b41b-4f7e4bb7be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:38.983252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 919/1867] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:38.992673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ca0c-21e7-4c5b-987f-ec922fa227aa admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:38.997045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:38.997340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:38.997618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:38.997791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41800d7ab89f44e5b721b7c0c7c1a09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d1bff3961842b98fad747c4206c03e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:38.998467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:38.998767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:38.999056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:38.999826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:39.000144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.002391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.014356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 949/1868] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:39.016079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:39.017334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:39.019290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.027900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 920/1869] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:39.029745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ac48-0a7f-4dbd-9d3d-b90bc702dca4 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.032663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.035131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41800d7ab89f44e5b721b7c0c7c1a09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d1bff3961842b98fad747c4206c03e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.035790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.039524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.039524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.039524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.039524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.042001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a45f1-89f9-41de-96bd-d17397fd4571 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.046551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.047240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.047527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.047807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.048557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:39.048871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.050586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.062717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 921/1870] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:45:39.067510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.077091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4cd26-dfae-4446-95ea-09d36a7bc773 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.082271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.082930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.083307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.083592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.084319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.086346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.188301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 922/1871] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:39 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:39.188665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 950/1872] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:39 2022] POST /identity/v3/projects => generated 355 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:39.191502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.191779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.270460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57880d0b-85ac-4433-92eb-e3e74cce7f2e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.272516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218174-ea9a-493c-8cc2-21bada6b39f2 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.277329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.278082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.278497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.278844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.281401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.283604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.342730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41800d7ab89f44e5b721b7c0c7c1a09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d1bff3961842b98fad747c4206c03e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.343449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.343744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.344033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.344842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:39.345158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.346822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.358521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 923/1873] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:39.372115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 951/1874] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:39 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:39.373545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.386993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363ffb-1104-47c5-a93d-64669fa4ff17 tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.391629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.392350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.392655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.392975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.393729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.395386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.410637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 924/1875] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:39.412272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.427284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83ee7-2863-406b-af7d-c69ec9b282a8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.428266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.430051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.430883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.431207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.431494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.432849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.435049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.443387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b10e2-8c0f-43f7-bba2-ff6de7e720bf admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.447980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 952/1876] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:39.454995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.463806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41800d7ab89f44e5b721b7c0c7c1a09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d1bff3961842b98fad747c4206c03e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.464711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.465001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.465323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] PATH_INFO: `/v3/projects/046f248c196d4757aea5aff25bc00160` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.467297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorizing `identity:delete_project(project_id=046f248c196d4757aea5aff25bc00160)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.469482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.473419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a07d3-89c3-4786-991e-cc89c838cbe2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.483376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442042-bab1-448d-90da-d0aac1676b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.484016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442042-bab1-448d-90da-d0aac1676b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.484297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442042-bab1-448d-90da-d0aac1676b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.484571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442042-bab1-448d-90da-d0aac1676b83 admin admin] PATH_INFO: `/v3/projects/4d106119521146089d782c24f8c977be/users/f379f20421fb44a48bb7b1ed1c5b1346/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.510998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d442042-bab1-448d-90da-d0aac1676b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d106119521146089d782c24f8c977be, user_id=f379f20421fb44a48bb7b1ed1c5b1346, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.513876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d442042-bab1-448d-90da-d0aac1676b83 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.519200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:39.607934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 953/1877] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:39 2022] PUT /identity/v3/projects/4d106119521146089d782c24f8c977be/users/f379f20421fb44a48bb7b1ed1c5b1346/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:39.616785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046f248c196d4757aea5aff25bc00160', 'request_id': 'req-8f287562-7178-4bc1-9a53-bd93e7bc316b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:39.618992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.619836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.620140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.624942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046f248c196d4757aea5aff25bc00160', 'request_id': 'req-8f287562-7178-4bc1-9a53-bd93e7bc316b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:39.634498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046f248c196d4757aea5aff25bc00160', 'request_id': 'req-8f287562-7178-4bc1-9a53-bd93e7bc316b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:39.650573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] MFA Rules not processed for user `f379f20421fb44a48bb7b1ed1c5b1346`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:39.651880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:39.719798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 954/1878] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:39.721896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] The token cache is being invalidate because project 046f248c196d4757aea5aff25bc00160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:39.722480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:39.723658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:39.729965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.731673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 925/1879] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:39 2022] DELETE /identity/v3/projects/046f248c196d4757aea5aff25bc00160 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:39.802670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e4380-97b6-4bbb-8a67-0312b884196b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:39.808715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:39.816325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:39.816325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:39.816325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:39.816325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:39.816325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:39.912549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 955/1880] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:39 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:39.916864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:39.926515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:39.959903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287562-7178-4bc1-9a53-bd93e7bc316b tempest-VolumeQuotaClassesTest-1965419118 tempest-VolumeQuotaClassesTest-1965419118-project-admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.039888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.040576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.040859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.041143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.041881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.043907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.091801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:40.142861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 926/1881] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:39 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:40.146643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.157404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e5fc3-eb71-42af-a54e-d612dbca56cf admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.162314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.163005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.163322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.163634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.164362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.165995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.180630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 956/1882] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:40.182589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.192458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd93cf3-08b6-4604-b908-444e983cb801 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.197465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.199908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.199908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.199908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] PATH_INFO: `/v3/projects/d842eb39a0604ba28bf1ffec89c6da7b/users/1239a9c10982442fbf91ac63cf4ebb7b/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.214435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d842eb39a0604ba28bf1ffec89c6da7b, user_id=1239a9c10982442fbf91ac63cf4ebb7b, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.217362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.303348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 927/1883] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:40 2022] PUT /identity/v3/projects/d842eb39a0604ba28bf1ffec89c6da7b/users/1239a9c10982442fbf91ac63cf4ebb7b/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:40.307333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.317780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195372-d3e2-4505-88c7-dc06b71fb696 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.344660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.346868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:40.382747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.383451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.383736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.384014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.384785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.386406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.396595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 957/1884] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:40.400685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.411089 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbb88a-1dd4-43b4-9886-d832b8e5a951 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.415853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a5e2-5049-473d-af20-40307e5298af admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.416086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a319a-5753-4646-88ed-55da47484762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.417038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a319a-5753-4646-88ed-55da47484762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.417323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a319a-5753-4646-88ed-55da47484762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.417598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a319a-5753-4646-88ed-55da47484762 admin admin] PATH_INFO: `/v3/projects/d842eb39a0604ba28bf1ffec89c6da7b/users/1239a9c10982442fbf91ac63cf4ebb7b/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.419607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a319a-5753-4646-88ed-55da47484762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d842eb39a0604ba28bf1ffec89c6da7b, user_id=1239a9c10982442fbf91ac63cf4ebb7b, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.420864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.421747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.422035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.422306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a319a-5753-4646-88ed-55da47484762 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.422430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] PATH_INFO: `/v3/users/2b7b75227b7e4d46a6650d6cc257118d` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.424246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7b75227b7e4d46a6650d6cc257118d)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.426233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.436441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 958/1885] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:40 2022] PUT /identity/v3/projects/d842eb39a0604ba28bf1ffec89c6da7b/users/1239a9c10982442fbf91ac63cf4ebb7b/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:40.450103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.450402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.450767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.477364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] MFA Rules not processed for user `1239a9c10982442fbf91ac63cf4ebb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:40.478560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:40.554900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 959/1886] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:40.567048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.569477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:40.581870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7b75227b7e4d46a6650d6cc257118d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:40.632209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725092c-a5b3-4996-a704-033e2cfd726f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.636778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c0b21-220d-4d8a-a130-c6ab5bc757a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.637435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0b21-220d-4d8a-a130-c6ab5bc757a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.637721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0b21-220d-4d8a-a130-c6ab5bc757a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.638002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0b21-220d-4d8a-a130-c6ab5bc757a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.649392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c0b21-220d-4d8a-a130-c6ab5bc757a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.650884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c0b21-220d-4d8a-a130-c6ab5bc757a1 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.661986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 960/1887] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:40.691173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7b75227b7e4d46a6650d6cc257118d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:40.693016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7b75227b7e4d46a6650d6cc257118d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:40.705721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7b75227b7e4d46a6650d6cc257118d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:40.712737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7b75227b7e4d46a6650d6cc257118d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:40.719278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 928/1888] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:40 2022] DELETE /identity/v3/users/2b7b75227b7e4d46a6650d6cc257118d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:40.724441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.724732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.725008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.742918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:40.744646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:40.808529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 961/1889] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:40.822486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.823906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:40.881341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a367d-4eeb-4e7a-88e5-12a66922c63d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:40.885980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:40.886642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:40.886928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:40.887249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:40.897003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:40.898436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:40.907807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 929/1890] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:40.983646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:40.984974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:40.986695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:41.047466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a927-423f-4438-b1c0-a792308dabb1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:41.051556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:41.052562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:41.052872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:41.055376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:41.057283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:41.116906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:41.118367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:41.130763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 962/1891] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:41.418381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:41.419817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:41.434815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535bba-aa24-4d4e-8c0e-d26e4eded686 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:41.440076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:41.440947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:41.441228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:41.441500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] PATH_INFO: `/v3/projects/e7b65ad8e5b649ccad0f871069277c09` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:41.443679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b65ad8e5b649ccad0f871069277c09)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:41.444816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:41.588060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b65ad8e5b649ccad0f871069277c09', 'request_id': 'req-0bef9649-e99b-4866-ac8b-85039f956a95'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:41.593271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b65ad8e5b649ccad0f871069277c09', 'request_id': 'req-0bef9649-e99b-4866-ac8b-85039f956a95'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:41.599488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b65ad8e5b649ccad0f871069277c09', 'request_id': 'req-0bef9649-e99b-4866-ac8b-85039f956a95'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:41.718988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] The token cache is being invalidate because project e7b65ad8e5b649ccad0f871069277c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:41.719312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:41.719966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:41.721603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 930/1892] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:41 2022] DELETE /identity/v3/projects/e7b65ad8e5b649ccad0f871069277c09 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:41.725666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:41.737673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2ba1a-bc07-401f-974d-f80a5e10ce6c service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:41.796465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:41.797344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:41.797625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:41.797902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] PATH_INFO: `/v3/users/41800d7ab89f44e5b721b7c0c7c1a09f` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:41.799901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41800d7ab89f44e5b721b7c0c7c1a09f)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:41.801858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:42.075419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41800d7ab89f44e5b721b7c0c7c1a09f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.076083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41800d7ab89f44e5b721b7c0c7c1a09f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.076683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41800d7ab89f44e5b721b7c0c7c1a09f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.088443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41800d7ab89f44e5b721b7c0c7c1a09f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.095910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7081359f-03c6-4a77-9f4d-06afab6c1560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41800d7ab89f44e5b721b7c0c7c1a09f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.171695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:42.177621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 963/1893] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:41 2022] DELETE /identity/v3/users/41800d7ab89f44e5b721b7c0c7c1a09f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:42.360146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:42.686568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:42.688030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:42.703829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9649-e99b-4866-ac8b-85039f956a95 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:42.761829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:42.762700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:42.762987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:42.763301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] PATH_INFO: `/v3/projects/28d1bff3961842b98fad747c4206c03e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:42.764548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d1bff3961842b98fad747c4206c03e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:42.766489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:42.896969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d1bff3961842b98fad747c4206c03e', 'request_id': 'req-31a84ee7-bef2-49f6-9a19-b8b99aeba399'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.903369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d1bff3961842b98fad747c4206c03e', 'request_id': 'req-31a84ee7-bef2-49f6-9a19-b8b99aeba399'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.910251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d1bff3961842b98fad747c4206c03e', 'request_id': 'req-31a84ee7-bef2-49f6-9a19-b8b99aeba399'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.963614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] The token cache is being invalidate because project 28d1bff3961842b98fad747c4206c03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:42.963937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.964595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-31a84ee7-bef2-49f6-9a19-b8b99aeba399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:42.966409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 931/1894] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:42 2022] DELETE /identity/v3/projects/28d1bff3961842b98fad747c4206c03e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:42.971302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:42.971753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:42.971893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:42.990876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:42.992131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:43.052813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 964/1895] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:43.061209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.061708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.062430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.081938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:43.083310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:43.091567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 932/1896] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:43.096051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.106022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdc632-4f4f-4e79-937a-4285871a1a58 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.110730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.111967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.112255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.112532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.113271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:43.113581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.115560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.131944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 965/1897] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:43.132999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.142720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b9561-785d-4009-83c8-31a6c87dc63d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.147433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.148090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.148371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.148647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.149344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.151269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.259247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 933/1898] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:43 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:43.263628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.273619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79fd9-d9a8-40eb-83ac-cf8f4abb7e58 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.330024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.330707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.330997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.331306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.332016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.333941 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.342793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:43.440425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 966/1899] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:43 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:43.445509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.458755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae066d9-32cc-46ca-89e9-ca521248a48c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.462594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:43.468492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.470042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.470042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.471143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.471653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.473497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.484758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 934/1900] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:43.489518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.501268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3435dc5-7343-4ace-b6d4-3dac8512d90a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.506623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae114c-8c6b-4256-9665-23aef8f7a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.508620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae114c-8c6b-4256-9665-23aef8f7a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.508620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae114c-8c6b-4256-9665-23aef8f7a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.508620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae114c-8c6b-4256-9665-23aef8f7a2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.508905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae114c-8c6b-4256-9665-23aef8f7a2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.510301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae114c-8c6b-4256-9665-23aef8f7a2e7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.522097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 967/1901] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:43.525662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.536762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5b49e-77bd-4919-a338-a4714dd7054e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.541874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.543075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.543395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.543760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] PATH_INFO: `/v3/projects/0d9a45950e234ed2a22ef7c03aa69ecb/users/192fdbe19cd142bfa5cb5471026f78bc/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.561797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9a45950e234ed2a22ef7c03aa69ecb, user_id=192fdbe19cd142bfa5cb5471026f78bc, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.564615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.680662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 935/1902] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:43 2022] PUT /identity/v3/projects/0d9a45950e234ed2a22ef7c03aa69ecb/users/192fdbe19cd142bfa5cb5471026f78bc/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:43.692116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.692408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.692686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.719730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] MFA Rules not processed for user `192fdbe19cd142bfa5cb5471026f78bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:43.721529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:43.784334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 968/1903] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:43.797406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.797406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:43.855368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74cef3-0bde-4983-ba0e-a44a006eb242 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.859009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e9b36-ee54-4ae0-87d8-43df9d99adff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.859854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9b36-ee54-4ae0-87d8-43df9d99adff service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.860279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9b36-ee54-4ae0-87d8-43df9d99adff service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.860689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9b36-ee54-4ae0-87d8-43df9d99adff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.870392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e9b36-ee54-4ae0-87d8-43df9d99adff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.871922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e9b36-ee54-4ae0-87d8-43df9d99adff service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:43.881732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 936/1904] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:43.901061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:43.964978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8930d-629e-4477-a3e4-f10875f1b8cf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:43.969755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:43.972079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:43.972079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:43.972079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] PATH_INFO: `/v3/users/192fdbe19cd142bfa5cb5471026f78bc` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:43.973076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192fdbe19cd142bfa5cb5471026f78bc)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:43.975002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:44.056478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:44.210018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192fdbe19cd142bfa5cb5471026f78bc'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.210986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192fdbe19cd142bfa5cb5471026f78bc'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.211638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192fdbe19cd142bfa5cb5471026f78bc'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.223742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192fdbe19cd142bfa5cb5471026f78bc'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.226801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:44.242992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192fdbe19cd142bfa5cb5471026f78bc'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.326544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 969/1905] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:43 2022] DELETE /identity/v3/users/192fdbe19cd142bfa5cb5471026f78bc => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:44.331214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:44.331671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:44.331961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:44.351388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:44.352788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:44.414526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 937/1906] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:44.424683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:44.426157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:44.497889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c269d-2f44-46ad-b720-a05ad24d5ca0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:44.503266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c73b1-cbf7-424e-ac59-89af3a0edd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:44.504076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c73b1-cbf7-424e-ac59-89af3a0edd85 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:44.504441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c73b1-cbf7-424e-ac59-89af3a0edd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:44.504709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c73b1-cbf7-424e-ac59-89af3a0edd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:44.516260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c73b1-cbf7-424e-ac59-89af3a0edd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:44.523176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c73b1-cbf7-424e-ac59-89af3a0edd85 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:44.525542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:44.530417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 970/1907] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:44.667402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:44.669757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:44.688763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047c3f4-857a-4c1f-a3d0-2786bd37bd6f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:44.694058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:44.695124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:44.696082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:44.696426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] PATH_INFO: `/v3/users/c5370aa32b924fbf95b2a9577f05f3aa` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:44.697691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5370aa32b924fbf95b2a9577f05f3aa)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:44.699799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:44.951008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5370aa32b924fbf95b2a9577f05f3aa'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.045651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5370aa32b924fbf95b2a9577f05f3aa'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.046295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5370aa32b924fbf95b2a9577f05f3aa'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.060800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5370aa32b924fbf95b2a9577f05f3aa'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.067904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5370aa32b924fbf95b2a9577f05f3aa'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.077165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 938/1908] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:44 2022] DELETE /identity/v3/users/c5370aa32b924fbf95b2a9577f05f3aa => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:45.079276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.080409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.080920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.092930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.097630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.103358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:45.104772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.200338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 971/1909] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:45.211414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.213120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.224873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b6e50-f7e3-463a-8b8c-1fb158a4f002 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.229951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.230980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.231311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.231596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] PATH_INFO: `/v3/projects/0d9a45950e234ed2a22ef7c03aa69ecb` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.232851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9a45950e234ed2a22ef7c03aa69ecb)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.234926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.286541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6cb8-8d2d-4d9c-8933-2f1bd94dab36 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.290293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e85a0f-8fe7-4e82-b113-d3ff0c552cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.290981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e85a0f-8fe7-4e82-b113-d3ff0c552cba service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.291299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e85a0f-8fe7-4e82-b113-d3ff0c552cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.291582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e85a0f-8fe7-4e82-b113-d3ff0c552cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.301466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e85a0f-8fe7-4e82-b113-d3ff0c552cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.302972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e85a0f-8fe7-4e82-b113-d3ff0c552cba service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.314229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 972/1910] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:45.360010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:45.412913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9a45950e234ed2a22ef7c03aa69ecb', 'request_id': 'req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.419139 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9a45950e234ed2a22ef7c03aa69ecb', 'request_id': 'req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.426813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9a45950e234ed2a22ef7c03aa69ecb', 'request_id': 'req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.512763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] The token cache is being invalidate because project 0d9a45950e234ed2a22ef7c03aa69ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:45.513057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.513706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f65ee4c9-ef28-4933-ab29-41cdfb3ff252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.515455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 939/1911] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:45 2022] DELETE /identity/v3/projects/0d9a45950e234ed2a22ef7c03aa69ecb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:45.521257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.521521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.521751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.555242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:45.556548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.643807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 973/1912] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:45.652155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.652610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.652984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.672908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:45.674295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.683356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 940/1913] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:45.687878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.700281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20a3d1-73c6-4c13-9fcf-fcf078e2a948 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.707468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.708302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.708644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.708926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.709801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:45.710012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.711679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.724349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 974/1914] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:45.728790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.738194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:45.742904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1ad6-6847-46f9-951e-a8bb60e841a8 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.752219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.752219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.752219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.763170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.768406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.770847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.863928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.865789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.880516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36669-50dd-4e63-be70-40871eba91ec admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.885455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.886351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.886594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.887072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] PATH_INFO: `/v3/projects/1f8cb75a454e4075acfdb6e7b6b9fcc4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.888557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8cb75a454e4075acfdb6e7b6b9fcc4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.890431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.981141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 941/1915] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:45.985177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.108742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526e26-2c27-4672-9ee6-1763b78ac87f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.128467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8cb75a454e4075acfdb6e7b6b9fcc4', 'request_id': 'req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.231562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.233828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8cb75a454e4075acfdb6e7b6b9fcc4', 'request_id': 'req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.234732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.234732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.236964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.237302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.239295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.261381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8cb75a454e4075acfdb6e7b6b9fcc4', 'request_id': 'req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.278628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] The token cache is being invalidate because project 1f8cb75a454e4075acfdb6e7b6b9fcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:46.280096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.280923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.284066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 975/1916] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:45 2022] DELETE /identity/v3/projects/1f8cb75a454e4075acfdb6e7b6b9fcc4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:46.301207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.309390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:46.334917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d19959-a1e8-4d3a-b07f-cdf3ffa1e780 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.340572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.341539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.341919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.342258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] PATH_INFO: `/v3/users/80dd4612860a4f93a634d765d5d64634` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.343590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dd4612860a4f93a634d765d5d64634)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.346188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.391176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 942/1917] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/users => generated 288 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:46.394122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.396033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:46.411536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949af4e-c8c9-4112-9fa0-0ede630408a7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.416360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.417041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.417333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.417620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.418362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.420002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.436663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 943/1918] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:46.437963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.449493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7675a-9546-4923-a90d-5c52b85dd9cd admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.454309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.455021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.455737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.455737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.456409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.458258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.481921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 944/1919] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:46.485850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.506997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85b36b-b5a8-448c-b594-8ede926198d8 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.516765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9e05-cdda-4f2b-9a4d-b5484fa48adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.518688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9e05-cdda-4f2b-9a4d-b5484fa48adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.519688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9e05-cdda-4f2b-9a4d-b5484fa48adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.520534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9e05-cdda-4f2b-9a4d-b5484fa48adb admin admin] PATH_INFO: `/v3/projects/4b502fc4ca3342b680e0202f777979ea/users/ede9743eafd84b2ca3a146df64549a47/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.544212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b9e05-cdda-4f2b-9a4d-b5484fa48adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b502fc4ca3342b680e0202f777979ea, user_id=ede9743eafd84b2ca3a146df64549a47, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.548056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b9e05-cdda-4f2b-9a4d-b5484fa48adb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.572529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dd4612860a4f93a634d765d5d64634'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.573540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dd4612860a4f93a634d765d5d64634'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.574257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dd4612860a4f93a634d765d5d64634'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.591400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dd4612860a4f93a634d765d5d64634'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.602744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dd4612860a4f93a634d765d5d64634'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:46.704174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 945/1920] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:46 2022] PUT /identity/v3/projects/4b502fc4ca3342b680e0202f777979ea/users/ede9743eafd84b2ca3a146df64549a47/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:46.715774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.716066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.716346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.731433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 976/1921] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:46 2022] DELETE /identity/v3/users/80dd4612860a4f93a634d765d5d64634 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:46.752737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] MFA Rules not processed for user `ede9743eafd84b2ca3a146df64549a47`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:46.753944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:46.821152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 946/1922] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:46.825629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.827152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:46.898665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8813dd8-1e2e-451d-bec0-a8519c749efd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.903612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.904284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.904562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.904837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.905608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.907626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.015040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 977/1923] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:46 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:47.019548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.032637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe047e6-abaa-461c-8d1f-f24af99df4a3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.129667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.132000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.132000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.132712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.134317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.137385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.169431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:47.228401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 947/1924] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:47 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:47.233735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.245409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061f88e-8160-4744-8d7f-c55027196f4d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.250140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.250902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.251293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.252367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.253177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.255047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.265991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 978/1925] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:47.270958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.281696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd30700-9ea4-4700-b6a6-d77b102c80e7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.286816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.287752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.288046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.288322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] PATH_INFO: `/v3/projects/6e9a99ffa4294ad0a84e93e22f9ab329/users/584e433491ea40269abfaf2d7a7826f5/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.304154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9a99ffa4294ad0a84e93e22f9ab329, user_id=584e433491ea40269abfaf2d7a7826f5, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.306868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.332696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.334619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:47.348320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca071-7f38-48de-ac3a-33e6a933e1c7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.355743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.356907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.357376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.357831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] PATH_INFO: `/v3/projects/8bc9450c814740b18b99f9baae827b78` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.359648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc9450c814740b18b99f9baae827b78)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.367978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.405292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 948/1926] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:47 2022] PUT /identity/v3/projects/6e9a99ffa4294ad0a84e93e22f9ab329/users/584e433491ea40269abfaf2d7a7826f5/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:47.406441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.496231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4ed5-29d9-4de5-ad66-125ff1384d64 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.496231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.496231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.496231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.496909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.496909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.498262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.509256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 949/1927] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:47.513221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.533155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0cae-14a6-42fe-a820-58bce9507165 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.538117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc9450c814740b18b99f9baae827b78', 'request_id': 'req-d5cbb311-62a4-43bd-92ef-74fe7ab85971'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:47.596126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daef2a-99f4-47cb-bb92-3af4a282906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.597046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daef2a-99f4-47cb-bb92-3af4a282906c admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.597386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daef2a-99f4-47cb-bb92-3af4a282906c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.597714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daef2a-99f4-47cb-bb92-3af4a282906c admin admin] PATH_INFO: `/v3/projects/6e9a99ffa4294ad0a84e93e22f9ab329/users/584e433491ea40269abfaf2d7a7826f5/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.599753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45daef2a-99f4-47cb-bb92-3af4a282906c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9a99ffa4294ad0a84e93e22f9ab329, user_id=584e433491ea40269abfaf2d7a7826f5, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.602432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45daef2a-99f4-47cb-bb92-3af4a282906c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.613646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 950/1928] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:47 2022] PUT /identity/v3/projects/6e9a99ffa4294ad0a84e93e22f9ab329/users/584e433491ea40269abfaf2d7a7826f5/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:47.633093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.633093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.633093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.659394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] MFA Rules not processed for user `584e433491ea40269abfaf2d7a7826f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:47.660732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:47.672555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc9450c814740b18b99f9baae827b78', 'request_id': 'req-d5cbb311-62a4-43bd-92ef-74fe7ab85971'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:47.684399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc9450c814740b18b99f9baae827b78', 'request_id': 'req-d5cbb311-62a4-43bd-92ef-74fe7ab85971'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:47.695886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] The token cache is being invalidate because project 8bc9450c814740b18b99f9baae827b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:47.696395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:47.697066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:47.698628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 979/1929] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:47 2022] DELETE /identity/v3/projects/8bc9450c814740b18b99f9baae827b78 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:47.709553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.711322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:47.725943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbb311-62a4-43bd-92ef-74fe7ab85971 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.736463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 951/1930] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:47.765351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:47.767118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:47.799684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.801351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.802022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.802553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] PATH_INFO: `/v3/users/59933b0f44ce44109dc3f391f56e74d2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.804553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59933b0f44ce44109dc3f391f56e74d2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.806993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.858736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b34c55-8082-4948-b73b-31e81e101591 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:47.863826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:47.864923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:47.865496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:47.865996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:47.868500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:47.954555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:47.958919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:47.966429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 952/1931] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:48.038568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59933b0f44ce44109dc3f391f56e74d2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.039301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59933b0f44ce44109dc3f391f56e74d2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.039922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59933b0f44ce44109dc3f391f56e74d2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.094199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59933b0f44ce44109dc3f391f56e74d2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.094853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a98b2bf0-60b0-4786-94b1-e15c54d8fc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59933b0f44ce44109dc3f391f56e74d2'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.203950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 980/1932] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:47 2022] DELETE /identity/v3/users/59933b0f44ce44109dc3f391f56e74d2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:48.360257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:48.705473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:48.725528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ff13-3d42-4296-bd75-42841c9b427c service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:48.754253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:48.784295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:48.785154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:48.785447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:48.785727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] PATH_INFO: `/v3/projects/b3b2935ce1cc4585bc5f7eeefb9d3d86` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:48.786901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b2935ce1cc4585bc5f7eeefb9d3d86)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:48.788913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:48.941478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b2935ce1cc4585bc5f7eeefb9d3d86', 'request_id': 'req-1292dc52-c8e5-4a21-9bc2-40ccab45c846'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.947678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b2935ce1cc4585bc5f7eeefb9d3d86', 'request_id': 'req-1292dc52-c8e5-4a21-9bc2-40ccab45c846'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:48.953995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b2935ce1cc4585bc5f7eeefb9d3d86', 'request_id': 'req-1292dc52-c8e5-4a21-9bc2-40ccab45c846'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:49.046751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] The token cache is being invalidate because project b3b2935ce1cc4585bc5f7eeefb9d3d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:49.047014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:49.047751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1292dc52-c8e5-4a21-9bc2-40ccab45c846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:49.050154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 953/1933] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:48 2022] DELETE /identity/v3/projects/b3b2935ce1cc4585bc5f7eeefb9d3d86 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:49.062021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.062021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.062021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.089384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:49.090779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:49.174598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 981/1934] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:49.183088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.183475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.183759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.204766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:49.206158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:49.214504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 954/1935] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:49.218723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:49.230626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a9d6-d75d-409d-a8b6-d5fbf48751ac None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:49.235544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:49.236783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.237170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.237348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.238087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:49.238402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:49.240150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:49.258541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 982/1936] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:49.260663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:49.270295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa230-f008-4002-bb34-fff62e0d30a6 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:49.280872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:49.281871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.282231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.282636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.284223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:49.286402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:49.390008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 955/1937] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:49 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:49.394035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:49.405071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab4e0a-2394-47c1-b39f-8102d87c53ac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:49.469356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:49.469356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.469356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.469356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.469689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:49.469689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:49.594315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 983/1938] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:49 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:49.599664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:49.609719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115b8e5-2c02-4181-a0c3-3ca5d9c8afac admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:49.614794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:49.621256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.621256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.621256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.621256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:49.621256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:49.629421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 956/1939] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:49.633738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:49.644621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054173c3-3542-43c9-8310-67edf96eb079 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:49.649503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7942f-3cb2-4036-8d41-bfe166aef556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:49.650171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7942f-3cb2-4036-8d41-bfe166aef556 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.650453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7942f-3cb2-4036-8d41-bfe166aef556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.650729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7942f-3cb2-4036-8d41-bfe166aef556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.651498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7942f-3cb2-4036-8d41-bfe166aef556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:49.653104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7942f-3cb2-4036-8d41-bfe166aef556 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:49.663722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 984/1940] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:49.667876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:49.677831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7a73-714c-42c0-9fa9-13f22c3fec9a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:49.682343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:49.683251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.683553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.683808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] PATH_INFO: `/v3/projects/3309a39038404ef2a4b9a3170a5fe1b2/users/9a379b1188a244c0a586f6f396a7955e/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.701287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3309a39038404ef2a4b9a3170a5fe1b2, user_id=9a379b1188a244c0a586f6f396a7955e, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:49.713037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:49.890708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 957/1941] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:49 2022] PUT /identity/v3/projects/3309a39038404ef2a4b9a3170a5fe1b2/users/9a379b1188a244c0a586f6f396a7955e/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:49.900818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:49.901110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:49.901390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:49.929900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] MFA Rules not processed for user `9a379b1188a244c0a586f6f396a7955e`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:49.931127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:49.993297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 985/1942] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:50.005977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.007757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:50.062382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ef1d-58c4-471d-b262-18bc50d8b545 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.066507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee27adb-120b-498c-996b-1ba79616be3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.067263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27adb-120b-498c-996b-1ba79616be3c service glance] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.067602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27adb-120b-498c-996b-1ba79616be3c service glance] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.067906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27adb-120b-498c-996b-1ba79616be3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.076284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee27adb-120b-498c-996b-1ba79616be3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.077716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee27adb-120b-498c-996b-1ba79616be3c service glance] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.087602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 958/1943] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:50.091263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:50.370864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:51.302418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:51.792112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:51.793874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:51.911517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b284ff-1ceb-4bf3-b38c-fd60c35befd8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:51.916846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:51.918290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:51.918660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:51.919249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] PATH_INFO: `/v3/users/f379f20421fb44a48bb7b1ed1c5b1346` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:51.921489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f379f20421fb44a48bb7b1ed1c5b1346)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:51.923989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:52.168072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f379f20421fb44a48bb7b1ed1c5b1346'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.169523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f379f20421fb44a48bb7b1ed1c5b1346'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.170143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f379f20421fb44a48bb7b1ed1c5b1346'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.177977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:52.191238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f379f20421fb44a48bb7b1ed1c5b1346'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.212752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f379f20421fb44a48bb7b1ed1c5b1346'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.331697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 986/1944] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:51 2022] DELETE /identity/v3/users/f379f20421fb44a48bb7b1ed1c5b1346 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:52.336358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:52.336649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:52.336952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:52.358802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:52.360071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:52.435522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:52.440935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:52.444257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:52.451354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 959/1945] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:52.461739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:52.463619 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:52.463813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa780d-63d7-45a4-98f1-f438b111dec0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:52.468699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:52.469626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:52.469911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:52.470188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] PATH_INFO: `/v3/users/ede9743eafd84b2ca3a146df64549a47` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:52.472107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede9743eafd84b2ca3a146df64549a47)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:52.474038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:52.532718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94454c-b03c-4605-b3bb-2714560e392f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:52.536927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64801-1eea-461b-a8b2-076d1df70628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:52.537577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64801-1eea-461b-a8b2-076d1df70628 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:52.537864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64801-1eea-461b-a8b2-076d1df70628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:52.538147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64801-1eea-461b-a8b2-076d1df70628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:52.547506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64801-1eea-461b-a8b2-076d1df70628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:52.549608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64801-1eea-461b-a8b2-076d1df70628 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:52.561893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 960/1946] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:52.660182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede9743eafd84b2ca3a146df64549a47'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.660953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede9743eafd84b2ca3a146df64549a47'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.661595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede9743eafd84b2ca3a146df64549a47'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.674197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede9743eafd84b2ca3a146df64549a47'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.709947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede9743eafd84b2ca3a146df64549a47'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:52.840816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 987/1947] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:52 2022] DELETE /identity/v3/users/ede9743eafd84b2ca3a146df64549a47 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:52.846192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:52.846628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:52.847283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:52.873020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:52.874312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:52.976516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:52.976940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 961/1948] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:52.978501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:53.078302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc10bc-0500-45e3-98d6-33c7608d3407 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:53.084237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:53.087757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:53.089188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:53.089573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:53.104539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:53.106273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:53.118414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 988/1949] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:53.222441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:53.225555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:53.275305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d44bd-1645-47ed-8c27-014ca3ab5c4c None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:53.287009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:53.288576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:53.289828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:53.289828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] PATH_INFO: `/v3/projects/4d106119521146089d782c24f8c977be` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:53.292429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d106119521146089d782c24f8c977be)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:53.297560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:53.482633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d106119521146089d782c24f8c977be', 'request_id': 'req-935ec1b0-3b85-4c47-b311-68f9ee506648'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:53.495270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d106119521146089d782c24f8c977be', 'request_id': 'req-935ec1b0-3b85-4c47-b311-68f9ee506648'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:53.504592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d106119521146089d782c24f8c977be', 'request_id': 'req-935ec1b0-3b85-4c47-b311-68f9ee506648'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:53.618357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] The token cache is being invalidate because project 4d106119521146089d782c24f8c977be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:53.618744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:53.620109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:53.621989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 962/1950] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:53 2022] DELETE /identity/v3/projects/4d106119521146089d782c24f8c977be => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:53.628144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:53.654471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d051e-a130-44e1-b7f3-965dba8bdaa4 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:53.717660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:53.753341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:53.754370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:53.754836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:53.755753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] PATH_INFO: `/v3/users/1239a9c10982442fbf91ac63cf4ebb7b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:53.756637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1239a9c10982442fbf91ac63cf4ebb7b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:53.758666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:53.828475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:54.016981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:54.018842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:54.021647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1239a9c10982442fbf91ac63cf4ebb7b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.022797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1239a9c10982442fbf91ac63cf4ebb7b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.023836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1239a9c10982442fbf91ac63cf4ebb7b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.039340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1239a9c10982442fbf91ac63cf4ebb7b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.050200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1239a9c10982442fbf91ac63cf4ebb7b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.059891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ec1b0-3b85-4c47-b311-68f9ee506648 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:54.067306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:54.068546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:54.078155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:54.078155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] PATH_INFO: `/v3/projects/4b502fc4ca3342b680e0202f777979ea` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:54.078155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b502fc4ca3342b680e0202f777979ea)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:54.078155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:54.136536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 989/1951] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:53 2022] DELETE /identity/v3/users/1239a9c10982442fbf91ac63cf4ebb7b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:54.247528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b502fc4ca3342b680e0202f777979ea', 'request_id': 'req-9a72d874-f94c-4bb7-b263-31bfda4edf0b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.260210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b502fc4ca3342b680e0202f777979ea', 'request_id': 'req-9a72d874-f94c-4bb7-b263-31bfda4edf0b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.274421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b502fc4ca3342b680e0202f777979ea', 'request_id': 'req-9a72d874-f94c-4bb7-b263-31bfda4edf0b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.376734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] The token cache is being invalidate because project 4b502fc4ca3342b680e0202f777979ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:54.377925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.378816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.381296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 963/1952] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:54 2022] DELETE /identity/v3/projects/4b502fc4ca3342b680e0202f777979ea => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:54.386221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:54.388277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:54.474655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8511f5-5a31-446e-871a-0080fd2e43dd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:54.610542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:54.613838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:54.614561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:54.615085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] PATH_INFO: `/v3/users/584e433491ea40269abfaf2d7a7826f5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:54.616964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=584e433491ea40269abfaf2d7a7826f5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:54.624371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:54.862110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:54.863730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:54.884920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72d874-f94c-4bb7-b263-31bfda4edf0b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:54.897108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:54.898278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:54.898708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:54.899143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] PATH_INFO: `/v3/projects/d842eb39a0604ba28bf1ffec89c6da7b` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:54.901290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d842eb39a0604ba28bf1ffec89c6da7b)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:54.903525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:54.929026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584e433491ea40269abfaf2d7a7826f5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.930551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584e433491ea40269abfaf2d7a7826f5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.931410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584e433491ea40269abfaf2d7a7826f5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.959415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584e433491ea40269abfaf2d7a7826f5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:54.967980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fd4985e8-bf40-4843-85ba-323d26a23eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584e433491ea40269abfaf2d7a7826f5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.043160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 990/1953] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:45:54 2022] DELETE /identity/v3/users/584e433491ea40269abfaf2d7a7826f5 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:55.054529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd842eb39a0604ba28bf1ffec89c6da7b', 'request_id': 'req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.061734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd842eb39a0604ba28bf1ffec89c6da7b', 'request_id': 'req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.072541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd842eb39a0604ba28bf1ffec89c6da7b', 'request_id': 'req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.131460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:55.182053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] The token cache is being invalidate because project d842eb39a0604ba28bf1ffec89c6da7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:55.182424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.183077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8dabac0d-b4ca-4df9-baa2-4f43da5afb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.188453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 964/1954] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:54 2022] DELETE /identity/v3/projects/d842eb39a0604ba28bf1ffec89c6da7b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:45:55.190404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.190694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.190976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.214706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:55.216088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:55.295277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 991/1955] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:55.303510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.306359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.306359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.348713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:55.362957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:55.396182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 965/1956] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:45:55.400184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.412131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914dce7-d48a-4b72-a8ee-c9f31380c7ce None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.417715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.418595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.418884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.419224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.419984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:55.420431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.421967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.428438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:55.435225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 992/1957] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:55.440927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.462560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce299b9-e22d-473e-910a-7c8ecc0ddb6f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.479926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.481291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.481609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.481893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.482628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.484849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.577575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 966/1958] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:55 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:55.582463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.592908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f933b-358b-4b86-adac-5a00232d07af admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.691807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.692910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.693291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.693645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.694518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.696607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.738890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.740775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:55.760031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3321d43-a0a9-478d-93cc-7d239a16bd4e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.765330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.766621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.772376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.772376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] PATH_INFO: `/v3/projects/6e9a99ffa4294ad0a84e93e22f9ab329` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.772376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9a99ffa4294ad0a84e93e22f9ab329)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.773405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.816279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 993/1959] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:55 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:55.820832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.831861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584dc6-6516-43a5-a450-8afdcbf7c8f4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.836885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.837693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.837984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.838266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.839005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.840667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.857232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 994/1960] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:55.858578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.871212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657a62f-cc1a-44e8-bcf3-970518149692 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.880553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.881239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.881527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.881805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.882545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.884556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.902437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 995/1961] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:55.905353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.918310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df059b-74e1-451f-87dc-870a3ad38c00 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.926495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9a99ffa4294ad0a84e93e22f9ab329', 'request_id': 'req-f7acecfe-4fe9-4311-86ee-ea653466c03d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.933603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9a99ffa4294ad0a84e93e22f9ab329', 'request_id': 'req-f7acecfe-4fe9-4311-86ee-ea653466c03d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.941976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9a99ffa4294ad0a84e93e22f9ab329', 'request_id': 'req-f7acecfe-4fe9-4311-86ee-ea653466c03d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:55.986650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba09f5-1f1e-4cd8-9ea5-b5bbb1267788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.988360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba09f5-1f1e-4cd8-9ea5-b5bbb1267788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.988705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba09f5-1f1e-4cd8-9ea5-b5bbb1267788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.989058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba09f5-1f1e-4cd8-9ea5-b5bbb1267788 admin admin] PATH_INFO: `/v3/projects/6c9bf0b3856b4cf58e750df31cce4d8d/users/bf315ed3d3ad4454a8211736be45eb34/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.005978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba09f5-1f1e-4cd8-9ea5-b5bbb1267788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9bf0b3856b4cf58e750df31cce4d8d, user_id=bf315ed3d3ad4454a8211736be45eb34, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:56.008774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba09f5-1f1e-4cd8-9ea5-b5bbb1267788 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:56.450891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] The token cache is being invalidate because project 6e9a99ffa4294ad0a84e93e22f9ab329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:56.457291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:56.457291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f7acecfe-4fe9-4311-86ee-ea653466c03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:56.458059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 967/1962] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:45:55 2022] DELETE /identity/v3/projects/6e9a99ffa4294ad0a84e93e22f9ab329 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:56.460096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ddd4a-fbdb-422d-89c6-e8e22cf56d73 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.461143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ddd4a-fbdb-422d-89c6-e8e22cf56d73 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.461620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ddd4a-fbdb-422d-89c6-e8e22cf56d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.493113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2a9ddd4a-fbdb-422d-89c6-e8e22cf56d73 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:56.494434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2a9ddd4a-fbdb-422d-89c6-e8e22cf56d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:56.496863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 996/1963] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:55 2022] PUT /identity/v3/projects/6c9bf0b3856b4cf58e750df31cce4d8d/users/bf315ed3d3ad4454a8211736be45eb34/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:56.507392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.512830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.512830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.561596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] MFA Rules not processed for user `bf315ed3d3ad4454a8211736be45eb34`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:56.563855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:56.648582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 968/1964] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:56.670661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.671043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.671427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.701646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:56.703444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:56.720989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 969/1965] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:56.725649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:56.732177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 997/1966] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:56.752625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:56.753988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3d8a2-057b-4e5f-9836-dbc9181acd05 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:56.755014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:56.761284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:56.762036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.762327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.762606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.763378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:56.763822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:56.765442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:56.778850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 970/1967] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:56.780542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b183c-09cc-4018-a9e7-b6b3a73ce7d6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:56.783472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:56.793562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:56.794551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.795039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.795646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.796622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:56.798817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:56.804658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604647a-3ea3-49c2-9ee7-c61f10e606f6 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:56.810355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:56.811025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.811374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.811623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.812985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:56.815437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:56.839085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:56.933031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 998/1968] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:56.936845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:56.965188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 971/1969] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:56.973613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.013080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d32d6c-7ecd-431c-b933-1a5241472657 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.076678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131fdb9-3c16-4bf8-ab7c-f59a3cdca414 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.084586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.085524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.085872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.086156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.086887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.089022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.100018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.101200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.101752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.104989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.105940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.108216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.426528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 999/1970] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:57.426528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.430163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 972/1971] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:57.430163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.431380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a096c-d9aa-45dd-bf67-93b3534f5ffb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.431480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d4aa-bd99-4ad9-92ac-4986d79357bf admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.431480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.431480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.431480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.431813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.431813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.432245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.432368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.432462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.432462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.432462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.432462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.432462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.432819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 973/1972] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:57.432908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1000/1973] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:57.432908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.433070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.433164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491809-f8e0-411f-b7cd-dd07e0f57039 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.433253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c9c1-c75b-4c58-86da-c02f20ff8a67 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.433390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.433390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.433390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.433390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.433776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.433887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.433966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.433966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.433966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.433966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.434277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.434359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.434359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 974/1974] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:57.436045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.450205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ea9b9-626a-4715-aec0-04c2c264106f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.465112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1001/1975] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:57.473942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333755ec-5a7f-4bd4-8cf8-6b3e6fabbcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.475631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333755ec-5a7f-4bd4-8cf8-6b3e6fabbcc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.476082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333755ec-5a7f-4bd4-8cf8-6b3e6fabbcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.476850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333755ec-5a7f-4bd4-8cf8-6b3e6fabbcc4 admin admin] PATH_INFO: `/v3/projects/39938b53b9e04d26b13b05b0239022ff/users/fdb761ab499840a7b6d19b13c1ba2229/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.482624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.500830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333755ec-5a7f-4bd4-8cf8-6b3e6fabbcc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39938b53b9e04d26b13b05b0239022ff, user_id=fdb761ab499840a7b6d19b13c1ba2229, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.504594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333755ec-5a7f-4bd4-8cf8-6b3e6fabbcc4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.518179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523d08-3f08-4f1c-97ff-3a048d853128 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.569672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678223-c4f3-4b1b-8f40-93f748e791f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.569672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678223-c4f3-4b1b-8f40-93f748e791f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.569672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678223-c4f3-4b1b-8f40-93f748e791f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.569672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678223-c4f3-4b1b-8f40-93f748e791f9 admin admin] PATH_INFO: `/v3/projects/a12e11299a964b9887250b654b7cafc3/users/43b7fb18572b458d938c11af56a5f5e0/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.589087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b678223-c4f3-4b1b-8f40-93f748e791f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12e11299a964b9887250b654b7cafc3, user_id=43b7fb18572b458d938c11af56a5f5e0, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.592029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b678223-c4f3-4b1b-8f40-93f748e791f9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.607152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 975/1976] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:57 2022] PUT /identity/v3/projects/39938b53b9e04d26b13b05b0239022ff/users/fdb761ab499840a7b6d19b13c1ba2229/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:57.624740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.625594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.626339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.663551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] MFA Rules not processed for user `fdb761ab499840a7b6d19b13c1ba2229`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:57.665241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:57.677286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1002/1977] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:57 2022] PUT /identity/v3/projects/a12e11299a964b9887250b654b7cafc3/users/43b7fb18572b458d938c11af56a5f5e0/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:57.690007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.690333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.690714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.736013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] MFA Rules not processed for user `43b7fb18572b458d938c11af56a5f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:57.737542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:57.776653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 976/1978] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:57.781332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.843288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1003/1979] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:57.856433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:57.857891 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:57.881049 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4689f5e-d13e-4b8e-bb75-9d4bc1b42afc None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.886064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.886833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.887236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.887600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.888307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.890250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.928709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406c2a1-2a5c-4b82-822d-7a7024185244 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:57.932676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:57.933650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:57.934049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:57.934350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:57.944962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:57.946388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:57.956318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1004/1980] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:58.025832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 977/1981] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:45:57 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:58.030200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:58.045753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0377c1-94e0-4885-ad5a-71fbf2654c58 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:58.118714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:58.119432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:58.119991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:58.120269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:58.120974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:58.123039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:58.216680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:58.263995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1005/1982] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:45:58 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:45:58.269147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:58.282331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd378bf-3ffb-459d-8c81-3aebb04c222a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:58.288602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:58.289490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:58.291269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:58.291269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:58.291269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:58.292652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:58.306020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 978/1983] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:45:58.309629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:58.320983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c57fb9-ac6e-4f98-8f25-e2718e663084 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:58.326668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:58.327933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:58.328271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:58.328541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] PATH_INFO: `/v3/projects/080f94f32fd248eea8e418c4d7fadda2/users/eaddf59efa954ad0a314706758da9185/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:58.349091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=080f94f32fd248eea8e418c4d7fadda2, user_id=eaddf59efa954ad0a314706758da9185, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:58.354860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:58.515290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1006/1984] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:58 2022] PUT /identity/v3/projects/080f94f32fd248eea8e418c4d7fadda2/users/eaddf59efa954ad0a314706758da9185/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:58.516240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:58.516240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e343e-3a5d-4c4c-a1f8-76abd68a70fd admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:58.573607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b90ed-6666-4c4b-a4d2-41aa2aa34abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:58.574314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b90ed-6666-4c4b-a4d2-41aa2aa34abe admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:58.574635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b90ed-6666-4c4b-a4d2-41aa2aa34abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:58.574918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b90ed-6666-4c4b-a4d2-41aa2aa34abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:58.575705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b90ed-6666-4c4b-a4d2-41aa2aa34abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:58.577738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b90ed-6666-4c4b-a4d2-41aa2aa34abe admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:58.596372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 979/1985] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:58.602068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:58.614505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b228-bfc5-4c4c-8f97-030c7c1fd43d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:58.619337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:58.620512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:58.620797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:58.621088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] PATH_INFO: `/v3/projects/080f94f32fd248eea8e418c4d7fadda2/users/eaddf59efa954ad0a314706758da9185/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:58.623180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080f94f32fd248eea8e418c4d7fadda2, user_id=eaddf59efa954ad0a314706758da9185, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:58.625822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:58.637590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1007/1986] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:45:58 2022] PUT /identity/v3/projects/080f94f32fd248eea8e418c4d7fadda2/users/eaddf59efa954ad0a314706758da9185/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:58.655232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:58.655232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:58.655232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:58.697078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] MFA Rules not processed for user `eaddf59efa954ad0a314706758da9185`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:58.698293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:58.708479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:58.775409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 980/1987] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:58.958629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:59.019303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d21c-964a-4250-8331-60bf5f2e5309 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:59.023067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:59.023779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:59.024065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:59.024347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:59.105739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:59.108461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:59.119119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1008/1988] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:00.359602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:00.713706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:01.863043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:01.954060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:02.700157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:02.703121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:02.723087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a08e6-1925-481f-93e0-50c4e13fa51b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:02.727691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87034-bef3-414d-a169-cf6bf1dc1c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:02.728486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87034-bef3-414d-a169-cf6bf1dc1c02 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:02.728900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87034-bef3-414d-a169-cf6bf1dc1c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:02.729193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87034-bef3-414d-a169-cf6bf1dc1c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:02.794486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87034-bef3-414d-a169-cf6bf1dc1c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:02.795974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87034-bef3-414d-a169-cf6bf1dc1c02 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:02.807569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 981/1989] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:46:02.942830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:03.046789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:03.317379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:03.568418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:03.645134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a63fd-9de5-4a65-8a6e-cc3a59d4ecd1 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:03.649848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:03.650735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:03.651017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:03.651324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] PATH_INFO: `/v3/users/43b7fb18572b458d938c11af56a5f5e0` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:03.652543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b7fb18572b458d938c11af56a5f5e0)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:03.654485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:03.942066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:03.948758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b7fb18572b458d938c11af56a5f5e0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:03.950382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b7fb18572b458d938c11af56a5f5e0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:03.950382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b7fb18572b458d938c11af56a5f5e0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:03.964634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b7fb18572b458d938c11af56a5f5e0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:03.971668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b7fb18572b458d938c11af56a5f5e0'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:04.153099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:04.153099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1009/1990] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:03 2022] DELETE /identity/v3/users/43b7fb18572b458d938c11af56a5f5e0 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:04.156057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:04.156646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:04.156802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:04.178698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:04.180679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:04.264324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 982/1991] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:04.274836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:04.276309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:04.341640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae34500-fab7-490e-abad-5e1e83e5f41d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:04.345601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:04.346439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:04.346948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:04.347120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:04.356522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:04.358015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:04.368395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1010/1992] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:04.582628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:04.759573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:04.761003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:04.823070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aa594-3d61-4812-815c-59c916687d7b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:04.826833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:04.827539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:04.827826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:04.828107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:04.829904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:04.937425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:04.940988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349e22-0c9b-4864-aa8d-c1640cd534a3 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:04.942181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:04.951430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 983/1993] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:04.969745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:05.091247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:05.097186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:05.114464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec13d5-5407-417e-9174-1754903db61d service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:05.121611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:05.122572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.122934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.123304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] PATH_INFO: `/v3/projects/a12e11299a964b9887250b654b7cafc3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.124518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12e11299a964b9887250b654b7cafc3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:05.126493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:05.264189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12e11299a964b9887250b654b7cafc3', 'request_id': 'req-2b408bda-68b9-44fc-986b-f39aea16b74f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:05.404406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12e11299a964b9887250b654b7cafc3', 'request_id': 'req-2b408bda-68b9-44fc-986b-f39aea16b74f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:05.412026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12e11299a964b9887250b654b7cafc3', 'request_id': 'req-2b408bda-68b9-44fc-986b-f39aea16b74f'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:05.423681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] The token cache is being invalidate because project a12e11299a964b9887250b654b7cafc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:05.423966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:05.424632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2b408bda-68b9-44fc-986b-f39aea16b74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:05.426293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1011/1994] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:05 2022] DELETE /identity/v3/projects/a12e11299a964b9887250b654b7cafc3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:05.431613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.432131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.432231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.451607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:05.456655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:05.534808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 984/1995] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:05.547869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.548343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.548629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.570962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:05.572279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:05.581132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1012/1996] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:05.585791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:05.596754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0807f-ae2b-4aa0-86a0-a5c225f42731 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:05.601573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:05.602231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.602514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.602790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.603554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:46:05.603867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:05.605753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:05.619082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 985/1997] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:46:05.624051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:05.634657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40bfd8-aef8-4724-8033-2f97f4a08f82 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:05.649613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:05.650298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.650580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.650858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.651603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:05.653933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:05.787042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1013/1998] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:46:05 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:05.795534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:05.804065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b99213-36da-41d4-9059-1f5e701d9e5d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:05.865072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:05.866224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.866692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.867195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.868418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:05.871981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:05.874353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:05.933729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:05.940608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 986/1999] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:46:05 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:05.944792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:05.956069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d886-bbd2-45ca-8218-615c620f8485 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:05.960864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:05.961542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.961867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.962113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.962862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:05.964581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:05.977165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1014/2000] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:05.981314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:05.991594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743235f4-e48f-42cd-9c71-02bd81b909cc admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:05.997557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f47806-4e4b-43ed-9f9b-f47dbc733619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:05.998322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47806-4e4b-43ed-9f9b-f47dbc733619 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:05.998615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47806-4e4b-43ed-9f9b-f47dbc733619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:05.998960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47806-4e4b-43ed-9f9b-f47dbc733619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:05.999836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f47806-4e4b-43ed-9f9b-f47dbc733619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:06.002142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f47806-4e4b-43ed-9f9b-f47dbc733619 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:06.014451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 987/2001] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:06.019495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:06.029694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2a40b-7dc2-4025-a729-3d02f12e131d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:06.035154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:06.035576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:06.035890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:06.036532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] PATH_INFO: `/v3/projects/485c8c6de3d34ae08491b570aa6c2520/users/1687d5d160e24bbaadab47bfd30e59f6/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:06.052346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=485c8c6de3d34ae08491b570aa6c2520, user_id=1687d5d160e24bbaadab47bfd30e59f6, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:06.055455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:06.125309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1015/2002] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:46:06 2022] PUT /identity/v3/projects/485c8c6de3d34ae08491b570aa6c2520/users/1687d5d160e24bbaadab47bfd30e59f6/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:06.136438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d2783-586e-464e-a407-a61d9455f42a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:06.136779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d2783-586e-464e-a407-a61d9455f42a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:06.137102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d2783-586e-464e-a407-a61d9455f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:06.166691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:06.170320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bc4d2783-586e-464e-a407-a61d9455f42a None None] MFA Rules not processed for user `1687d5d160e24bbaadab47bfd30e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:06.172590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bc4d2783-586e-464e-a407-a61d9455f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:06.199255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:06.262364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 988/2003] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:06.273058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:06.274783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:06.333408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ed288-cc1a-4c6f-b039-90be1f3014ec admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:06.337890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:06.338648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:06.338938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:06.339273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:06.348149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:06.349591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:06.359121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1016/2004] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:06.370922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:06.524675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:07.490858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:07.622487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:08.005499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:08.101479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:08.633818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:08.755968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:09.084778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:09.638207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:10.488960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b776-8bc5-486e-94f8-186a3a4439da None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:10.489406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b776-8bc5-486e-94f8-186a3a4439da None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:10.489555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b776-8bc5-486e-94f8-186a3a4439da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:10.508946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-1a39b776-8bc5-486e-94f8-186a3a4439da None None] MFA Rules not processed for user `1687d5d160e24bbaadab47bfd30e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:10.510151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1a39b776-8bc5-486e-94f8-186a3a4439da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:10.517338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 989/2005] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:10.799839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:20.503089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=18 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:21.347927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:23.434500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:23.436480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:23.585893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163404aa-2fc3-4462-b51f-3815ace2cf3d service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:23.591334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:23.592224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:23.592505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:23.592782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] PATH_INFO: `/v3/users/bf315ed3d3ad4454a8211736be45eb34` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:23.593997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf315ed3d3ad4454a8211736be45eb34)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:23.596640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:23.787794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf315ed3d3ad4454a8211736be45eb34'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:23.788455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf315ed3d3ad4454a8211736be45eb34'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:23.789067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf315ed3d3ad4454a8211736be45eb34'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:23.803735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf315ed3d3ad4454a8211736be45eb34'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:23.812832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf315ed3d3ad4454a8211736be45eb34'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:23.897477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1017/2006] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:23 2022] DELETE /identity/v3/users/bf315ed3d3ad4454a8211736be45eb34 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:23.902956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:23.902956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:23.902956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:23.930629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:23.931875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:24.012975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 990/2007] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:24.023331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:24.024790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:24.070953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:24.141961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94dd8-21d8-49c3-95d1-5e157976424e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:24.148855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:24.149128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:24.149544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:24.149966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:24.162542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:24.164191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:24.181055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1018/2008] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:24.663362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:24.665530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:24.703037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2257f5-4c88-4f8b-9582-e4e10de7d5c3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:24.707946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:24.708823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:24.709113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:24.709417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] PATH_INFO: `/v3/projects/6c9bf0b3856b4cf58e750df31cce4d8d` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:24.710615 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9bf0b3856b4cf58e750df31cce4d8d)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:24.712699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:24.832569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9bf0b3856b4cf58e750df31cce4d8d', 'request_id': 'req-5de25bc9-34ee-46ec-af92-bec6ffa59316'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:24.838482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9bf0b3856b4cf58e750df31cce4d8d', 'request_id': 'req-5de25bc9-34ee-46ec-af92-bec6ffa59316'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:24.846795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9bf0b3856b4cf58e750df31cce4d8d', 'request_id': 'req-5de25bc9-34ee-46ec-af92-bec6ffa59316'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:24.981733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] The token cache is being invalidate because project 6c9bf0b3856b4cf58e750df31cce4d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:24.982391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:24.982887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:24.984509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 991/2009] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:24 2022] DELETE /identity/v3/projects/6c9bf0b3856b4cf58e750df31cce4d8d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:46:24.988665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:25.010113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0497f-4caf-4a8a-8b9e-ed4a08c78b55 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:25.070160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:25.071047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:25.071366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:25.071662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] PATH_INFO: `/v3/users/fdb761ab499840a7b6d19b13c1ba2229` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:25.072918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb761ab499840a7b6d19b13c1ba2229)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:25.074901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:25.309026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb761ab499840a7b6d19b13c1ba2229'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:25.309705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb761ab499840a7b6d19b13c1ba2229'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:25.310321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb761ab499840a7b6d19b13c1ba2229'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:25.324006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb761ab499840a7b6d19b13c1ba2229'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:25.331596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb761ab499840a7b6d19b13c1ba2229'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:25.405784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1019/2010] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:24 2022] DELETE /identity/v3/users/fdb761ab499840a7b6d19b13c1ba2229 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:25.937558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:25.938976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:25.956174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25bc9-34ee-46ec-af92-bec6ffa59316 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:26.041494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:26.042648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:26.042952 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:26.043379 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] PATH_INFO: `/v3/projects/39938b53b9e04d26b13b05b0239022ff` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:26.044664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39938b53b9e04d26b13b05b0239022ff)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:26.046682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:26.048385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:26.158211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39938b53b9e04d26b13b05b0239022ff', 'request_id': 'req-0924d57b-13b6-43a8-bdeb-04930562980b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.164498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39938b53b9e04d26b13b05b0239022ff', 'request_id': 'req-0924d57b-13b6-43a8-bdeb-04930562980b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.171448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39938b53b9e04d26b13b05b0239022ff', 'request_id': 'req-0924d57b-13b6-43a8-bdeb-04930562980b'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.234565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] The token cache is being invalidate because project 39938b53b9e04d26b13b05b0239022ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:26.235346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.236094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.238564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 992/2011] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:25 2022] DELETE /identity/v3/projects/39938b53b9e04d26b13b05b0239022ff => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:26.246070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:26.246070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:26.262584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67853ae-69ff-45f4-8068-4f36212d0398 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:26.272303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:26.331703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:26.333674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:26.333674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:26.333674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] PATH_INFO: `/v3/users/eaddf59efa954ad0a314706758da9185` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:26.334897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaddf59efa954ad0a314706758da9185)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:26.336884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:26.539668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaddf59efa954ad0a314706758da9185'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.540374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaddf59efa954ad0a314706758da9185'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.541158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaddf59efa954ad0a314706758da9185'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.572791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaddf59efa954ad0a314706758da9185'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.580339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01499519-cf20-4f52-96e4-55c8241c7b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaddf59efa954ad0a314706758da9185'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:26.666723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1020/2012] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:26 2022] DELETE /identity/v3/users/eaddf59efa954ad0a314706758da9185 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:27.379818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:27.383797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:27.400965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d57b-13b6-43a8-bdeb-04930562980b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:27.460034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:27.460941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.461232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.461523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] PATH_INFO: `/v3/projects/080f94f32fd248eea8e418c4d7fadda2` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.462719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080f94f32fd248eea8e418c4d7fadda2)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:27.464712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:27.603561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080f94f32fd248eea8e418c4d7fadda2', 'request_id': 'req-3c050f78-597d-4986-8c26-8c9b880a3a96'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:27.608988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080f94f32fd248eea8e418c4d7fadda2', 'request_id': 'req-3c050f78-597d-4986-8c26-8c9b880a3a96'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:27.615858 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080f94f32fd248eea8e418c4d7fadda2', 'request_id': 'req-3c050f78-597d-4986-8c26-8c9b880a3a96'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:27.723996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] The token cache is being invalidate because project 080f94f32fd248eea8e418c4d7fadda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:27.724291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:27.724915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3c050f78-597d-4986-8c26-8c9b880a3a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:27.726509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 993/2013] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:27 2022] DELETE /identity/v3/projects/080f94f32fd248eea8e418c4d7fadda2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:27.731449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.731922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.732043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.770324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:27.775193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:27.832355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1021/2014] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:27.840102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.840403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.840692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.859523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:27.860687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:27.869640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 994/2015] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:27.875559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:27.885697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a2b8f-72bb-44bf-a828-82f2517a28bf None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:27.890501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:27.891222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.891511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.891790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.892523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:46:27.892835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:27.894480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:27.906177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1022/2016] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:46:27.912354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:27.921801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95707ea5-b676-414d-9c81-ca52a6096639 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:27.927233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:27.927894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.928206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.928487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.929180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:27.931116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:27.941660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:28.053334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 995/2017] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:46:27 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:28.058329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:28.064785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:28.070048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba354f-7a16-49b7-8144-3bc96dd1ff53 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:28.128059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:28.128663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.128951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.129229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.130011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:28.131994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:28.260247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1023/2018] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:46:28 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:28.265395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:28.278620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39371ac8-a6b8-471f-beb5-cd8318c58230 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:28.284448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:28.285043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.285400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.285767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.286629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:28.288335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:28.302173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 996/2019] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:28.303619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:28.314318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b68c-1835-4f04-af83-25d2133b88d0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:28.319491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0be4cc-54e5-4dd5-9595-5ebf83a44f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:28.320174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be4cc-54e5-4dd5-9595-5ebf83a44f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.320463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be4cc-54e5-4dd5-9595-5ebf83a44f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.320805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be4cc-54e5-4dd5-9595-5ebf83a44f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.323236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0be4cc-54e5-4dd5-9595-5ebf83a44f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:28.323380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0be4cc-54e5-4dd5-9595-5ebf83a44f3e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:28.342200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1024/2020] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:28.343429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:28.354330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbc8ab-ed03-4493-ac2b-b0e2fa36ea14 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:28.359512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:28.360416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.360710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.361012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] PATH_INFO: `/v3/projects/b0c39de631f44292b3b0875386f17f3f/users/bcaa4a7ea30242128c78eee9c2c73dfe/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.380238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c39de631f44292b3b0875386f17f3f, user_id=bcaa4a7ea30242128c78eee9c2c73dfe, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:28.383271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:28.479588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 997/2021] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:46:28 2022] PUT /identity/v3/projects/b0c39de631f44292b3b0875386f17f3f/users/bcaa4a7ea30242128c78eee9c2c73dfe/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:46:28.491934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.492312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.492692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.519521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:28.520707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:28.578924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1025/2022] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:28.589460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:28.591382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:28.653338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18e73-3b10-479a-9748-aa2ec9fffb3e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:28.657620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:28.658362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.665745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.665745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.670438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:28.672053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:28.683370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 998/2023] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:29.013918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:29.015428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:29.030613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d634-5cfe-47f2-9032-ebf405485573 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:29.034478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:29.035485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:29.035843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:29.036192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] PATH_INFO: `/v3/users/6a7cf8b784d44b5ebf246c9541e781d5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:29.037549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7cf8b784d44b5ebf246c9541e781d5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:29.039632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:29.335523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7cf8b784d44b5ebf246c9541e781d5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:29.336315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7cf8b784d44b5ebf246c9541e781d5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:29.337215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7cf8b784d44b5ebf246c9541e781d5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:29.358385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7cf8b784d44b5ebf246c9541e781d5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:29.366699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-59212f8a-046d-4b64-8034-0ff62f862522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7cf8b784d44b5ebf246c9541e781d5'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:29.370954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:29.458054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1026/2024] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:29 2022] DELETE /identity/v3/users/6a7cf8b784d44b5ebf246c9541e781d5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:46:29.757969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:29.769966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca058caf-821f-408d-aff9-3f9d791cf00b service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:29.837689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:29.838663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:29.839044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:29.839258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] PATH_INFO: `/v3/projects/ddcee48ecf6d4132a40fb625f930c43f` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:29.840497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcee48ecf6d4132a40fb625f930c43f)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:29.842425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:29.999237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcee48ecf6d4132a40fb625f930c43f', 'request_id': 'req-4ac72e6c-e952-46ca-87cb-9f63441ff98c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:30.004903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcee48ecf6d4132a40fb625f930c43f', 'request_id': 'req-4ac72e6c-e952-46ca-87cb-9f63441ff98c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:30.006730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:30.011403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcee48ecf6d4132a40fb625f930c43f', 'request_id': 'req-4ac72e6c-e952-46ca-87cb-9f63441ff98c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:30.141099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] The token cache is being invalidate because project ddcee48ecf6d4132a40fb625f930c43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:30.141386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:30.142027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-4ac72e6c-e952-46ca-87cb-9f63441ff98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:30.144252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 999/2025] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:29 2022] DELETE /identity/v3/projects/ddcee48ecf6d4132a40fb625f930c43f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:30.149265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.149758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.149902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.170115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:30.172029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:30.246133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1027/2026] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:30.254996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6629d4b-e09f-4bb2-8564-eb86890c7499 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.255349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6629d4b-e09f-4bb2-8564-eb86890c7499 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.255827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6629d4b-e09f-4bb2-8564-eb86890c7499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.275036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b6629d4b-e09f-4bb2-8564-eb86890c7499 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:30.276305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b6629d4b-e09f-4bb2-8564-eb86890c7499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:30.284863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1000/2027] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:30.288979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.301355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c2816-e66f-4b87-bda1-defa9ea3c47a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.310295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.310602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.310888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.315980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.316697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.317244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.317579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.318981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:46:30.319560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.321311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.337074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1028/2028] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:46:30.347112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] MFA Rules not processed for user `bcaa4a7ea30242128c78eee9c2c73dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:30.348437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:30.351140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.362020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3088c8d-9028-4ed7-a596-7586b0d850bc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.366696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.367496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.367847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.368194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.368961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.371359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.449677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1001/2029] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:30.461210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.462529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:30.492926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1029/2030] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:46:30 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:30.498308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.528068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cedf17-2099-433d-80f3-f676e25621b5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.571112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449cf9d-393c-46b6-a401-c5370c73e9e6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.576160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.577104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.577224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.577424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.578146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.580532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.599103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.599792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.600084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.600364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.657439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.658930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.668163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1002/2031] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:46:30.690910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:30.700670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1030/2032] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:46:30 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:30.704355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.715750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92646c-94c4-4b9e-8e45-0cf855f23371 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.721069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.721765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.722074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.722354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.723085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.724910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.742485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1003/2033] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:30.746549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.757432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a96e35-7f51-4ffb-b460-fc62b367946c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.762806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea903b7-2902-4210-a160-c5b0c971f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.763487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea903b7-2902-4210-a160-c5b0c971f3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.764029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea903b7-2902-4210-a160-c5b0c971f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.764337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea903b7-2902-4210-a160-c5b0c971f3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.765091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea903b7-2902-4210-a160-c5b0c971f3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.766736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea903b7-2902-4210-a160-c5b0c971f3a7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.778346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1031/2034] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:46:30.782580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:30.793831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7cdf3-c078-4a63-8641-14d9568d8c7f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:30.801413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:30.802823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.803126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.803413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] PATH_INFO: `/v3/projects/e80aa9835e9845e798b1c8346de141e3/users/8b0a82159c6343d28546ec7c775b8791/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.821437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80aa9835e9845e798b1c8346de141e3, user_id=8b0a82159c6343d28546ec7c775b8791, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:30.824936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:30.960393 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1004/2035] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:46:30 2022] PUT /identity/v3/projects/e80aa9835e9845e798b1c8346de141e3/users/8b0a82159c6343d28546ec7c775b8791/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:30.965674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779a51-bad0-4b1f-8b9b-c7200a08cb90 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:30.965905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779a51-bad0-4b1f-8b9b-c7200a08cb90 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:30.966248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779a51-bad0-4b1f-8b9b-c7200a08cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:30.984879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c8779a51-bad0-4b1f-8b9b-c7200a08cb90 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:30.986229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c8779a51-bad0-4b1f-8b9b-c7200a08cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:31.026805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:31.054784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1032/2036] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:31.065816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:31.068050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:31.130989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c649-40f1-48f3-9139-48e342e384ca admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:31.134984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152e4c3-1335-493a-a00c-19ec7a3fd1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:31.135664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e4c3-1335-493a-a00c-19ec7a3fd1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:31.135950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e4c3-1335-493a-a00c-19ec7a3fd1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:31.136228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e4c3-1335-493a-a00c-19ec7a3fd1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:31.146540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152e4c3-1335-493a-a00c-19ec7a3fd1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:31.148008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152e4c3-1335-493a-a00c-19ec7a3fd1e8 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:31.157711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1005/2037] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:33.582181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:33.582730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:33.582730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:33.604343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] MFA Rules not processed for user `bcaa4a7ea30242128c78eee9c2c73dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:33.605607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:33.690928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1033/2038] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:37.910796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db915bff-9a0e-42d0-9005-170d48e8eab6 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:37.910796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db915bff-9a0e-42d0-9005-170d48e8eab6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:37.910796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db915bff-9a0e-42d0-9005-170d48e8eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:37.940514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-db915bff-9a0e-42d0-9005-170d48e8eab6 None None] MFA Rules not processed for user `8b0a82159c6343d28546ec7c775b8791`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:37.941960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-db915bff-9a0e-42d0-9005-170d48e8eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:38.016837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1006/2039] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:38.032360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:38.034555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:38.119835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f177-765f-4412-a4bc-89e7480f55d4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:38.128645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:38.129312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:38.129603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:38.129882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:38.139439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:38.141238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:38.153596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1034/2040] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:41.041272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24900ba9-bfea-43ba-bdd3-6db6e215139a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:41.046306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24900ba9-bfea-43ba-bdd3-6db6e215139a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:41.046306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24900ba9-bfea-43ba-bdd3-6db6e215139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:41.065662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-24900ba9-bfea-43ba-bdd3-6db6e215139a None None] MFA Rules not processed for user `8b0a82159c6343d28546ec7c775b8791`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:41.066902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-24900ba9-bfea-43ba-bdd3-6db6e215139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:41.082206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1007/2041] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:48.149523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=68 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:51.059060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:52.421573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:52.423055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:52.438213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ec11-3e30-43d5-bc69-f0e6fa6ba609 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:52.444267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:52.444417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:52.444702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:52.444975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] PATH_INFO: `/v3/users/dcfc9eea64ab4a639a2bf144b583e4e3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:52.446185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfc9eea64ab4a639a2bf144b583e4e3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:52.448215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:52.657222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfc9eea64ab4a639a2bf144b583e4e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:52.657890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfc9eea64ab4a639a2bf144b583e4e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:52.658742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfc9eea64ab4a639a2bf144b583e4e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:52.672782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfc9eea64ab4a639a2bf144b583e4e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:52.680861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfc9eea64ab4a639a2bf144b583e4e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:52.798351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1035/2042] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:52 2022] DELETE /identity/v3/users/dcfc9eea64ab4a639a2bf144b583e4e3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:52.803598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:52.804172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:52.804299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:52.821929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:52.823292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:52.886911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1008/2043] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:52.896728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:52.898112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:52.953408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697b72-b1d5-4803-af8f-9f1be7647a16 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:52.957314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:52.957961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:52.958276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:52.958640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:52.967925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:52.969366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:52.980204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1036/2044] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:53.539279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:53.540727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:53.555797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4071d-eb2a-47b9-a63d-9e216d49884d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:53.560592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:53.561596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:53.562170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:53.562539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] PATH_INFO: `/v3/projects/0874819dec4144c3b356951f12474adb` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:53.563802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0874819dec4144c3b356951f12474adb)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:53.565893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:53.713807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0874819dec4144c3b356951f12474adb', 'request_id': 'req-84d804fa-2f99-4847-9e36-7afcd3f2edc5'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:53.719306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0874819dec4144c3b356951f12474adb', 'request_id': 'req-84d804fa-2f99-4847-9e36-7afcd3f2edc5'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:53.726253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0874819dec4144c3b356951f12474adb', 'request_id': 'req-84d804fa-2f99-4847-9e36-7afcd3f2edc5'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:53.822136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] The token cache is being invalidate because project 0874819dec4144c3b356951f12474adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:53.822822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:53.823383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:53.825000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1009/2045] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:53 2022] DELETE /identity/v3/projects/0874819dec4144c3b356951f12474adb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:53.829078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:53.839537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6aa20-feee-46bc-9204-f977f1484dd6 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:53.905137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:53.906511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:53.907119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:53.907465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] PATH_INFO: `/v3/users/c5051de01f8a42649dd73c2cd95e9686` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:53.909446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5051de01f8a42649dd73c2cd95e9686)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:53.911781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:53.929210 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:54.160544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5051de01f8a42649dd73c2cd95e9686'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:54.161203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5051de01f8a42649dd73c2cd95e9686'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:54.161797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5051de01f8a42649dd73c2cd95e9686'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:54.173900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5051de01f8a42649dd73c2cd95e9686'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:54.180804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-33113f2b-8e7c-49d8-8914-a03dc48a7ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5051de01f8a42649dd73c2cd95e9686'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:54.295801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1037/2046] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:46:53 2022] DELETE /identity/v3/users/c5051de01f8a42649dd73c2cd95e9686 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:54.920157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:54.921678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:54.936168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d804fa-2f99-4847-9e36-7afcd3f2edc5 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.006807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.008587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.009082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.009563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] PATH_INFO: `/v3/projects/a63e53401dd54c019c08a08facc90afa` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.011018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63e53401dd54c019c08a08facc90afa)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.013191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.114508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:55.133625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63e53401dd54c019c08a08facc90afa', 'request_id': 'req-34551585-5d3f-4c11-b582-0ccba17c9cf9'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:55.139350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63e53401dd54c019c08a08facc90afa', 'request_id': 'req-34551585-5d3f-4c11-b582-0ccba17c9cf9'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:55.145871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63e53401dd54c019c08a08facc90afa', 'request_id': 'req-34551585-5d3f-4c11-b582-0ccba17c9cf9'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:55.238634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] The token cache is being invalidate because project a63e53401dd54c019c08a08facc90afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:46:55.238935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:55.239613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-34551585-5d3f-4c11-b582-0ccba17c9cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:46:55.245007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1010/2047] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:46:54 2022] DELETE /identity/v3/projects/a63e53401dd54c019c08a08facc90afa => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:55.247388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.248005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.248005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.288568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:55.289796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:55.356829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1038/2048] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:55.364484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.364807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.365057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.383777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:55.384992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:55.393540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1011/2049] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:55.397845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.407410 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181563-00ef-4eb6-be52-5630b06276ce None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.412653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.413312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.413592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.413868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.414597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:46:55.414905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.416555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacea61-f595-417d-9587-bfe89f0d39c3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.428641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1039/2050] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:46:55.433142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.443027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0be-0893-4c84-bd36-7ccf8ed62a94 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.448316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.448923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.449259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.449535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.450228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.452176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.462199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.462542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.462932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.493143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:55.494386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:55.546891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1012/2051] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:46:55 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:55.548363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.562965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1040/2052] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:55.605690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.607163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:55.612074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:55.616312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431b38a-77df-4f09-b0a7-dc78019d76d9 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.621694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.622374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.622653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.622926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.623656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.625732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.679002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd4c7a-fa2f-4579-bb0b-b18cf8dde7c3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.738674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.739369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.739710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.739989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.795268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.796967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.805614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1041/2053] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:46:55.807802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1013/2054] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:46:55 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:46:55.808321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.820074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a54fc1-0283-4bf8-ae7f-70391c119b0d service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.825102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.825779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.826090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.826362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.828736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.828736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.842008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1042/2055] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:46:55.846509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.860458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39272541-edf3-4c8c-a73a-929f9a604dcb admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.862775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37330d24-0ecf-4a0c-a6be-872d78b223d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.863806 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330d24-0ecf-4a0c-a6be-872d78b223d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.864171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330d24-0ecf-4a0c-a6be-872d78b223d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.864523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330d24-0ecf-4a0c-a6be-872d78b223d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.865341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37330d24-0ecf-4a0c-a6be-872d78b223d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.867224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37330d24-0ecf-4a0c-a6be-872d78b223d3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:55.882201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1014/2056] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:46:55.883501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:55.894223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46efb1-24df-47ab-bbe8-573dc6ecfcf9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:55.898884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:55.899821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:55.900103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:55.900389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] PATH_INFO: `/v3/projects/c4a2f35201ba433293e37d28c95bbd59/users/89b20c4373364959ab02e45b6c7c96b4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:55.915544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a2f35201ba433293e37d28c95bbd59, user_id=89b20c4373364959ab02e45b6c7c96b4, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:55.918361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.044937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1043/2057] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:46:55 2022] PUT /identity/v3/projects/c4a2f35201ba433293e37d28c95bbd59/users/89b20c4373364959ab02e45b6c7c96b4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:56.056737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.057237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.057384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.086215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] MFA Rules not processed for user `89b20c4373364959ab02e45b6c7c96b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:56.087463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:56.143500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:56.154255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1015/2058] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:56.158739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:56.171532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:56.226504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9e902-9b18-4550-94c1-b6e43ae3e9be admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:56.244996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:56.246077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.246273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.246631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.247349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:56.249457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.378306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1044/2059] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:46:56 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:56.383088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:56.396044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea3aba-8d8c-40f4-8149-c7b06a776c37 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:56.492859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:56.493841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.494358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.494789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.497650 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:56.498229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.602105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1016/2060] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:46:56 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:46:56.603327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:56.613475 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48790-af67-47d8-ada0-1a00daa1560d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:56.618047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:56.618752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.619035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.619369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.620179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:56.622391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.641266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1045/2061] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:56.644740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:56.654919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496550-97e1-40da-8635-61e80c05b9fa admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:56.659548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d0e91-2a51-42a6-a57e-35cec1226ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:56.660441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d0e91-2a51-42a6-a57e-35cec1226ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.660729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d0e91-2a51-42a6-a57e-35cec1226ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.661017 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d0e91-2a51-42a6-a57e-35cec1226ef5 admin admin] PATH_INFO: `/v3/projects/e181a20392ba41b39f58a745d7d3a80b/users/a20bcca3c6be4e1ca2dad234532b5777/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.676079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d0e91-2a51-42a6-a57e-35cec1226ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e181a20392ba41b39f58a745d7d3a80b, user_id=a20bcca3c6be4e1ca2dad234532b5777, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:56.684036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d0e91-2a51-42a6-a57e-35cec1226ef5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.833513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1017/2062] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:46:56 2022] PUT /identity/v3/projects/e181a20392ba41b39f58a745d7d3a80b/users/a20bcca3c6be4e1ca2dad234532b5777/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:46:56.837583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:56.849018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833b4e9-e70c-42ad-ad63-34ccc7d3a361 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:56.914150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:56.914894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.915695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.916048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.916875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:56.917456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.917822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.918174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.918816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.929793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1046/2063] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:46:56.933777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:56.938057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:56.939846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:56.944494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128d44-cabc-4589-83f6-cd923647f980 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:56.957107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e21b41-5000-4899-a00c-cbc40d36031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:56.958304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21b41-5000-4899-a00c-cbc40d36031a admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:56.958720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21b41-5000-4899-a00c-cbc40d36031a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:56.959125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21b41-5000-4899-a00c-cbc40d36031a admin admin] PATH_INFO: `/v3/projects/e181a20392ba41b39f58a745d7d3a80b/users/a20bcca3c6be4e1ca2dad234532b5777/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:56.965154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e21b41-5000-4899-a00c-cbc40d36031a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e181a20392ba41b39f58a745d7d3a80b, user_id=a20bcca3c6be4e1ca2dad234532b5777, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:56.968969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e21b41-5000-4899-a00c-cbc40d36031a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:56.989460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1047/2064] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:46:56 2022] PUT /identity/v3/projects/e181a20392ba41b39f58a745d7d3a80b/users/a20bcca3c6be4e1ca2dad234532b5777/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:46:57.001759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:57.002470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:57.003179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:57.009605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1018/2065] 10.222.0.32 () {58 vars in 967 bytes} [Mon May 23 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:57.026626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:57.046343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] MFA Rules not processed for user `a20bcca3c6be4e1ca2dad234532b5777`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:57.047623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:57.111790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4cd12-b3d4-4d72-9446-07671e52b6c0 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:57.116665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:57.128344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:57.139619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1048/2066] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:57.152135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:57.153691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:57.182376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4cf9-a4c6-464d-866f-b3792b63c201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:57.183071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4cf9-a4c6-464d-866f-b3792b63c201 service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:57.183400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4cf9-a4c6-464d-866f-b3792b63c201 service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:57.183694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4cf9-a4c6-464d-866f-b3792b63c201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:57.224926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084a99-fd75-475c-b7aa-476d538b4952 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:57.229504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:57.230169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:57.230460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:57.230734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:57.248373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:57.250072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:57.260103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4cf9-a4c6-464d-866f-b3792b63c201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:57.261863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4cf9-a4c6-464d-866f-b3792b63c201 service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:57.262985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1049/2067] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:46:57.272869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1019/2068] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:46:57.600636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:57.609860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080c39-3e47-4fd6-8b75-3cf7e4769753 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:57.614443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:57.615375 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:57.615778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:57.616071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:57.677308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:57.678759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:57.688673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1050/2069] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:46:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:58.805629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e99c2c-c735-44c4-b6c1-e9b3a6af8baa None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:58.806552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e99c2c-c735-44c4-b6c1-e9b3a6af8baa None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:58.807076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e99c2c-c735-44c4-b6c1-e9b3a6af8baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:58.833159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-21e99c2c-c735-44c4-b6c1-e9b3a6af8baa None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:58.834531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-21e99c2c-c735-44c4-b6c1-e9b3a6af8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:58.858482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1020/2070] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:58.859382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:58.874496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28623ce-fd60-44ae-8c17-a0e2822c9adf service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:58.886723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:58.886723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:58.886723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:58.886723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:58.891761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:58.894020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:58.903636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1051/2071] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:46:59.642099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:59.644494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:59.644494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:59.661659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:59.662966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:59.670403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1021/2072] 10.222.0.32 () {58 vars in 967 bytes} [Mon May 23 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:59.683777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:59.695244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07a0f-5bd9-45aa-9209-534f40a97861 service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:59.700329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f8796-13bf-42b7-b452-6ba7d6a9e901 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:59.700975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f8796-13bf-42b7-b452-6ba7d6a9e901 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:59.701257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f8796-13bf-42b7-b452-6ba7d6a9e901 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:59.701533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f8796-13bf-42b7-b452-6ba7d6a9e901 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:59.710608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f8796-13bf-42b7-b452-6ba7d6a9e901 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:59.713481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f8796-13bf-42b7-b452-6ba7d6a9e901 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:59.721358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1052/2073] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:46:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:47:02.784303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:02.789449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:02.857280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe798c8-5fd6-4364-84b4-30a264d2ec46 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:02.861906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:02.862790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:02.863074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:02.863383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] PATH_INFO: `/v3/users/1687d5d160e24bbaadab47bfd30e59f6` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:02.864600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1687d5d160e24bbaadab47bfd30e59f6)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:02.866898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:03.078739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:03.087401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1687d5d160e24bbaadab47bfd30e59f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:03.198315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1687d5d160e24bbaadab47bfd30e59f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:03.198955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1687d5d160e24bbaadab47bfd30e59f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:03.213076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1687d5d160e24bbaadab47bfd30e59f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:03.221970 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1687d5d160e24bbaadab47bfd30e59f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:03.248226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:03.248765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:03.248859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:03.251196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1022/2074] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:02 2022] DELETE /identity/v3/users/1687d5d160e24bbaadab47bfd30e59f6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:03.271479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:03.272445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:03.377844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1053/2075] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:03.391677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:03.395762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:03.473846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c123ad-1655-44ee-9f2f-02ee7f0cfa99 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:03.477453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a9d2b-056e-4637-967b-e604764c1054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:03.478107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a9d2b-056e-4637-967b-e604764c1054 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:03.478399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a9d2b-056e-4637-967b-e604764c1054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:03.478684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a9d2b-056e-4637-967b-e604764c1054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:03.488535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a9d2b-056e-4637-967b-e604764c1054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:03.492789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a9d2b-056e-4637-967b-e604764c1054 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:03.500398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1023/2076] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:03.804636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:03.804636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:03.825777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b076d9-0e0d-466c-8353-b85cce90949b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:03.837503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:03.838454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:03.838694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:03.839615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] PATH_INFO: `/v3/projects/485c8c6de3d34ae08491b570aa6c2520` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:03.840963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=485c8c6de3d34ae08491b570aa6c2520)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:03.843790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:03.855309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:04.119596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485c8c6de3d34ae08491b570aa6c2520', 'request_id': 'req-5b687cc0-962e-4054-801d-c5769c9a8eba'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:04.272568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485c8c6de3d34ae08491b570aa6c2520', 'request_id': 'req-5b687cc0-962e-4054-801d-c5769c9a8eba'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:04.279688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485c8c6de3d34ae08491b570aa6c2520', 'request_id': 'req-5b687cc0-962e-4054-801d-c5769c9a8eba'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:04.290177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] The token cache is being invalidate because project 485c8c6de3d34ae08491b570aa6c2520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:04.290466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:04.291157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5b687cc0-962e-4054-801d-c5769c9a8eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:04.292702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1054/2077] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:03 2022] DELETE /identity/v3/projects/485c8c6de3d34ae08491b570aa6c2520 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:04.297629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.298110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.298244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.318022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:04.319201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:04.380225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1024/2078] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:04.387996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.388289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.388566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.407126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:04.408454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:04.416782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1055/2079] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:04.421206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:04.431664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07275d-e44a-4519-8ef7-08aa2f8f8639 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:04.436281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:04.436946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.437227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.437503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.438572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:47:04.438889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:04.441122 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:04.456429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1025/2080] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:47:04.457890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:04.467566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1afcf-2a7f-4eea-ad08-95ecd4b9782f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:04.472367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:04.473055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.473420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.473703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.474399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:04.476352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:04.576193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1056/2081] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:04 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:04.577348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:04.588204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b549e0-11a8-4559-b82a-450bf9a50e3b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:04.636901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:04.652995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:04.653679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.653993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.654269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.654980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:04.656972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:04.793510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1026/2082] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:04 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:04.800342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:04.810716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ed0b3-e3de-4016-a9d8-f9690a19b741 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:04.816237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:04.816934 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.817243 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.817505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.818249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:04.819989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:04.831716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1057/2083] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:47:04.835721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:04.846937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c0ee-4925-4714-90aa-822963e55359 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:04.851779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217daf65-da83-418e-ac6f-08c57be757b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:04.852459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217daf65-da83-418e-ac6f-08c57be757b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.852732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217daf65-da83-418e-ac6f-08c57be757b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.853013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217daf65-da83-418e-ac6f-08c57be757b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.853747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217daf65-da83-418e-ac6f-08c57be757b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:04.855391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217daf65-da83-418e-ac6f-08c57be757b4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:04.866654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1027/2084] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:04.870803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:04.881090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b1998-9c6e-468b-87e9-89062acdce33 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:04.885837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:04.886724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.887035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.887324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] PATH_INFO: `/v3/projects/7e22027c2e5948a6ba154c837a7673a9/users/cc4c3405e93141fc851f22e49eee09bd/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.903783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e22027c2e5948a6ba154c837a7673a9, user_id=cc4c3405e93141fc851f22e49eee09bd, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:04.906478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:04.982114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1058/2085] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:04 2022] PUT /identity/v3/projects/7e22027c2e5948a6ba154c837a7673a9/users/cc4c3405e93141fc851f22e49eee09bd/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:04.987721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4240a14-99b9-4116-8827-5caa7c73c0c0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.988043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4240a14-99b9-4116-8827-5caa7c73c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.988322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4240a14-99b9-4116-8827-5caa7c73c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:05.006626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b4240a14-99b9-4116-8827-5caa7c73c0c0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:05.007989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b4240a14-99b9-4116-8827-5caa7c73c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:05.074387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1028/2086] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:05.084482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:05.091423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:05.156940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112a01-5c91-4983-afd9-6d077f14f064 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:05.161881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:05.167112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:05.167112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:05.167112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:05.173563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:05.175055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:05.187951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1059/2087] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:06.576793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c4b3-53ef-4e13-8f5b-db9a7bbd5d81 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:06.577306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c4b3-53ef-4e13-8f5b-db9a7bbd5d81 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:06.577416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c4b3-53ef-4e13-8f5b-db9a7bbd5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:06.603931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c0a8c4b3-53ef-4e13-8f5b-db9a7bbd5d81 None None] MFA Rules not processed for user `cc4c3405e93141fc851f22e49eee09bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:06.605144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c0a8c4b3-53ef-4e13-8f5b-db9a7bbd5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:06.674950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1029/2088] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:06.685823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:06.687229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:06.722573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:06.766512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682d93-3392-4834-b03c-2ad6a6fd7c7f service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:06.770394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:06.771033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:06.771344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:06.771620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:06.779979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:06.781416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:06.790679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1060/2089] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:09.713864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4bfed-544c-4df8-ae66-08f94285c5f1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:09.713864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4bfed-544c-4df8-ae66-08f94285c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:09.713864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4bfed-544c-4df8-ae66-08f94285c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:09.728083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4cc4bfed-544c-4df8-ae66-08f94285c5f1 None None] MFA Rules not processed for user `cc4c3405e93141fc851f22e49eee09bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:09.729443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4cc4bfed-544c-4df8-ae66-08f94285c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:09.737713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1030/2090] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:13.030720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:13.032297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:13.045803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f8e7-65eb-45f7-8525-730aefb0e7ad service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:13.050331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:13.051221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:13.051510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:13.051787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] PATH_INFO: `/v3/users/9a379b1188a244c0a586f6f396a7955e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:13.052985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a379b1188a244c0a586f6f396a7955e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:13.054926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:13.270537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a379b1188a244c0a586f6f396a7955e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:13.271250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a379b1188a244c0a586f6f396a7955e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:13.271867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a379b1188a244c0a586f6f396a7955e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:13.284461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a379b1188a244c0a586f6f396a7955e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:13.291352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a379b1188a244c0a586f6f396a7955e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:13.346713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1061/2091] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:13 2022] DELETE /identity/v3/users/9a379b1188a244c0a586f6f396a7955e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:13.351499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:13.352084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:13.352218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:13.370865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:13.372355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:13.421972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:13.440133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1031/2092] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:13.450443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:13.451887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:13.514992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150a706-4355-4b50-8f5d-a8c615e2ec8e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:13.519281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc38dd3-014a-40f2-bc07-86e89290968a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:13.520982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38dd3-014a-40f2-bc07-86e89290968a service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:13.521271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38dd3-014a-40f2-bc07-86e89290968a service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:13.521894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc38dd3-014a-40f2-bc07-86e89290968a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:13.532133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38dd3-014a-40f2-bc07-86e89290968a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:13.534326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc38dd3-014a-40f2-bc07-86e89290968a service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:13.546398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1062/2093] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:14.132125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:14.133633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:14.148067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d83c-58a1-4c36-a01f-ff81e5a7881c None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:14.153085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:14.153960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.154244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.154521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] PATH_INFO: `/v3/projects/3309a39038404ef2a4b9a3170a5fe1b2` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.155841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3309a39038404ef2a4b9a3170a5fe1b2)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:14.158546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:14.297473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3309a39038404ef2a4b9a3170a5fe1b2', 'request_id': 'req-309e052b-e846-4059-8120-7a2a3b0335e1'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:14.303363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3309a39038404ef2a4b9a3170a5fe1b2', 'request_id': 'req-309e052b-e846-4059-8120-7a2a3b0335e1'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:14.312053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3309a39038404ef2a4b9a3170a5fe1b2', 'request_id': 'req-309e052b-e846-4059-8120-7a2a3b0335e1'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:14.409849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] The token cache is being invalidate because project 3309a39038404ef2a4b9a3170a5fe1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:14.410958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:14.412041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-309e052b-e846-4059-8120-7a2a3b0335e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:14.413964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1032/2094] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:14 2022] DELETE /identity/v3/projects/3309a39038404ef2a4b9a3170a5fe1b2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:14.419576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.419576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.419576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.442645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:14.444049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:14.488043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:14.536077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1063/2095] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:14.545217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.545514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.545835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.568848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:14.570199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:14.579060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1033/2096] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:14.583961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:14.596200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d915-0c49-4f37-b7bc-efdaa158b40d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:14.601250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:14.602007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.602314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.602639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.603438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:47:14.603767 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:14.605395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:14.618267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1064/2097] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:47:14.623089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:14.634778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d719b4-b6af-4db2-8873-611fed7ba1d4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:14.646240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:14.647205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.647400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.647688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.648620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:14.650600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:14.665085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:14.667278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:14.684386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f10c-c41e-4e42-8b64-977b3ce5393f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:14.689836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:14.690701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.690983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.691291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] PATH_INFO: `/v3/users/89b20c4373364959ab02e45b6c7c96b4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.692499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b20c4373364959ab02e45b6c7c96b4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:14.694581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:14.774404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1034/2098] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:14 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:47:14.779800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:14.858418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3fe74-96b9-446a-b4f4-ebfc6db1ad4d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:14.863936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:14.864625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:14.864913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:14.865464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:14.865912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:14.867937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.045010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1035/2099] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:14 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:47:15.049690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.055862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b20c4373364959ab02e45b6c7c96b4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:15.056914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b20c4373364959ab02e45b6c7c96b4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:15.057601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b20c4373364959ab02e45b6c7c96b4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:15.060792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd26a-4224-453b-99f4-878ebf8a0763 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.069417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.070406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.070691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.070968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.071808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.074168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.075971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b20c4373364959ab02e45b6c7c96b4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:15.084929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4e300604-bb1d-4507-9939-c03fa2450fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b20c4373364959ab02e45b6c7c96b4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:15.086190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1036/2100] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:47:15.092006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.094113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.109831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee39892-c285-45dd-b04a-5998deaa437f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.117609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.119758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.120054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.120339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.121503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.123166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.139546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1037/2101] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:47:15.141145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.152218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8edb0-9d65-474f-b5d4-727c6b881d08 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.157187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002a74-4725-4a31-b87c-91c19cdd5cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.158646 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002a74-4725-4a31-b87c-91c19cdd5cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.158940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002a74-4725-4a31-b87c-91c19cdd5cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.159255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002a74-4725-4a31-b87c-91c19cdd5cef admin admin] PATH_INFO: `/v3/projects/bec8554c7bbb4315b2edc601d1295d02/users/e77fdf9c8c494b24a7e23eed8d035dce/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.162945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:15.187632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002a74-4725-4a31-b87c-91c19cdd5cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec8554c7bbb4315b2edc601d1295d02, user_id=e77fdf9c8c494b24a7e23eed8d035dce, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.196547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002a74-4725-4a31-b87c-91c19cdd5cef admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.205095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1065/2102] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:14 2022] DELETE /identity/v3/users/89b20c4373364959ab02e45b6c7c96b4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:15.212685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.213340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.213963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.244359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:15.245593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.320150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1038/2103] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:15 2022] PUT /identity/v3/projects/bec8554c7bbb4315b2edc601d1295d02/users/e77fdf9c8c494b24a7e23eed8d035dce/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:15.325241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1066/2104] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:15.331579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.332144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.332527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.341763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.343801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.379324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] MFA Rules not processed for user `e77fdf9c8c494b24a7e23eed8d035dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:15.380597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.400577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:15.440707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c0ae-92d8-4a0b-9087-2c35463f83b7 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.461372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1039/2105] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:15.475580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.477230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.528777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b31fd6-2e1d-47a2-9c20-f00321ca8665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.529586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31fd6-2e1d-47a2-9c20-f00321ca8665 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.529976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31fd6-2e1d-47a2-9c20-f00321ca8665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.530362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31fd6-2e1d-47a2-9c20-f00321ca8665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.574046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a7b5-8493-4f5b-be47-1cc28dd9b018 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.580348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.581167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.581658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.582440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.594618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.597053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.609136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1040/2106] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:47:15.631262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b31fd6-2e1d-47a2-9c20-f00321ca8665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.639381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b31fd6-2e1d-47a2-9c20-f00321ca8665 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.644201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.648361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1067/2107] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:47:15.656435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b25a9-01d0-40ac-94ab-f132fdd91f73 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.662680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.663599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.663888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.664179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] PATH_INFO: `/v3/users/e77fdf9c8c494b24a7e23eed8d035dce` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.665523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77fdf9c8c494b24a7e23eed8d035dce)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.667531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.967576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77fdf9c8c494b24a7e23eed8d035dce'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.049497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77fdf9c8c494b24a7e23eed8d035dce'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.050594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77fdf9c8c494b24a7e23eed8d035dce'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.064910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77fdf9c8c494b24a7e23eed8d035dce'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.066329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:16.072971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77fdf9c8c494b24a7e23eed8d035dce'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.080418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1041/2108] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:15 2022] DELETE /identity/v3/users/e77fdf9c8c494b24a7e23eed8d035dce => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:16.084775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:16.086189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:16.086189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:16.104234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:16.105740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:16.195630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:16.197398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:16.213276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0979f85-c607-457d-89f7-61f80f652ece admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:16.218779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:16.219873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:16.223872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:16.223872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] PATH_INFO: `/v3/projects/c4a2f35201ba433293e37d28c95bbd59` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:16.223872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a2f35201ba433293e37d28c95bbd59)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:16.224870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:16.228996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1068/2109] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:16.237591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:16.239250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:16.311411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:16.329560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2643-2b5a-4c29-9d2a-ad9d142222d0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:16.333321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:16.333965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:16.334247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:16.334519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:16.344722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:16.346653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:16.358044 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1069/2110] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:16.360050 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a2f35201ba433293e37d28c95bbd59', 'request_id': 'req-13004b16-71f0-4395-9800-121bd33c494f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.366611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a2f35201ba433293e37d28c95bbd59', 'request_id': 'req-13004b16-71f0-4395-9800-121bd33c494f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.381743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a2f35201ba433293e37d28c95bbd59', 'request_id': 'req-13004b16-71f0-4395-9800-121bd33c494f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.487730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] The token cache is being invalidate because project c4a2f35201ba433293e37d28c95bbd59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:16.487730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.487730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.487730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1042/2111] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:16 2022] DELETE /identity/v3/projects/c4a2f35201ba433293e37d28c95bbd59 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:16.488501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:16.495423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51627137-6c92-4f1f-87a6-fd61621ed9e5 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:16.558820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:16.559729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:16.560011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:16.560295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] PATH_INFO: `/v3/users/a20bcca3c6be4e1ca2dad234532b5777` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:16.561545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20bcca3c6be4e1ca2dad234532b5777)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:16.566190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:16.839352 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20bcca3c6be4e1ca2dad234532b5777'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.840337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20bcca3c6be4e1ca2dad234532b5777'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.841379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20bcca3c6be4e1ca2dad234532b5777'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.858902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20bcca3c6be4e1ca2dad234532b5777'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.866263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8fe93f6b-f0c4-4091-8b82-4cce424b0f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20bcca3c6be4e1ca2dad234532b5777'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:16.948867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:16.950424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:16.965491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13004b16-71f0-4395-9800-121bd33c494f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:16.970632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:16.972812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:16.973618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:16.973915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] PATH_INFO: `/v3/projects/bec8554c7bbb4315b2edc601d1295d02` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:16.975556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec8554c7bbb4315b2edc601d1295d02)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:16.977623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:17.048974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1070/2112] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:16 2022] DELETE /identity/v3/users/a20bcca3c6be4e1ca2dad234532b5777 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:17.147802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec8554c7bbb4315b2edc601d1295d02', 'request_id': 'req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.153241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec8554c7bbb4315b2edc601d1295d02', 'request_id': 'req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.159383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec8554c7bbb4315b2edc601d1295d02', 'request_id': 'req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.289195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] The token cache is being invalidate because project bec8554c7bbb4315b2edc601d1295d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:17.289491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.290133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8522ccd9-4687-41c0-ab1a-08bf6d41f4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.292279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1043/2113] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:16 2022] DELETE /identity/v3/projects/bec8554c7bbb4315b2edc601d1295d02 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:17.300528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.300528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.300771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:17.353848 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:17.355120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:17.416252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:17.427138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1071/2114] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:17.435086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.435407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.435696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:17.454752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:17.456134 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:17.466052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1044/2115] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:17.471627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:17.482676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55151682-905d-4ccc-92e8-ec4a416a656c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:17.489997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:17.490637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.490886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.491223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:17.491972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:47:17.492379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:17.494030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:17.507484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1072/2116] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:47:17.511836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:17.521348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427019-3f77-46b7-8bd8-818f836ec8b1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:17.526324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:17.526996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.527310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.527594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:17.528287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:17.544553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:17.577016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:17.579193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:17.593478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37bb6-8bc4-4aaf-bfd2-ee5f2cedf60d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:17.600356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:17.601689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.608190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.608190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] PATH_INFO: `/v3/projects/e181a20392ba41b39f58a745d7d3a80b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:17.608190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e181a20392ba41b39f58a745d7d3a80b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:17.608190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:17.675670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1045/2117] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:17 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:17.679954 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:17.727129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:17.819795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbad34-0d62-469a-b3e1-7f5927f6c6ff admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:17.826526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e181a20392ba41b39f58a745d7d3a80b', 'request_id': 'req-919143eb-b74a-4697-b73a-66d22bde1972'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.892639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:17.893330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.893803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.894080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:17.895064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:17.897342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:17.964976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e181a20392ba41b39f58a745d7d3a80b', 'request_id': 'req-919143eb-b74a-4697-b73a-66d22bde1972'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.974681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e181a20392ba41b39f58a745d7d3a80b', 'request_id': 'req-919143eb-b74a-4697-b73a-66d22bde1972'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.985457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] The token cache is being invalidate because project e181a20392ba41b39f58a745d7d3a80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:17.985849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.986561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-919143eb-b74a-4697-b73a-66d22bde1972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:17.988996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1073/2118] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:17 2022] DELETE /identity/v3/projects/e181a20392ba41b39f58a745d7d3a80b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:17.995175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de83f-892f-46e1-b23b-472030dd397c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:17.995175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de83f-892f-46e1-b23b-472030dd397c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:17.995175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de83f-892f-46e1-b23b-472030dd397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.014032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-389de83f-892f-46e1-b23b-472030dd397c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.015358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-389de83f-892f-46e1-b23b-472030dd397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.026878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1074/2119] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:18.035130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.035655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.036087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.055796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.057190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.085833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1075/2120] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:18.102397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.120165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ec8d-a1eb-47bd-86cd-3cfb55941e22 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.125844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.126795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.127083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.127755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.128464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:47:18.135411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.137611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.145859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1046/2121] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:17 2022] POST /identity/v3/users => generated 284 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:47:18.149665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.160083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.161199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1076/2122] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:47:18.168373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.174219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd4fa-8a3e-45bd-b1b7-c2d9b64f3e04 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.180992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.183085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.183491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.183773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.184935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.190326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.191000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f149c-5012-4c3d-b567-8f456601080b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.204416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1047/2123] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:18.206662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.207628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.208220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.208490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.208836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.209829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.212010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.224974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed271165-b8c1-4524-b3c6-576186f6f215 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.231527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.233424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.233902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.234386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.235566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.238734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.252385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1048/2124] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:18.256564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.270631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873286-a6ed-430a-84db-161fc28dd105 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.276267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ec85-68ed-466e-b884-b2ca17f89b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.279165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ec85-68ed-466e-b884-b2ca17f89b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.279165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ec85-68ed-466e-b884-b2ca17f89b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.279165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ec85-68ed-466e-b884-b2ca17f89b6d admin admin] PATH_INFO: `/v3/projects/652580a82e9c4f3b84eda950e5613a48/users/e6ed5088d3494139b93a7d2af4b48a12/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.295184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ec85-68ed-466e-b884-b2ca17f89b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=652580a82e9c4f3b84eda950e5613a48, user_id=e6ed5088d3494139b93a7d2af4b48a12, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.302947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ec85-68ed-466e-b884-b2ca17f89b6d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.413017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1077/2125] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:18.431075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.477798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1049/2126] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:18 2022] PUT /identity/v3/projects/652580a82e9c4f3b84eda950e5613a48/users/e6ed5088d3494139b93a7d2af4b48a12/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:18.483257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.483550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.483828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.513971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.515120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.558255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06025e9a-adf9-4210-91a7-abd0794ed576 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.614879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1050/2127] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:18.625654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.627366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.700976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.701678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.701965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.702244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.702955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.705532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.755707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfb9e-c3f0-493b-9667-ddca5095a4d5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.761304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d4e21-9454-4f08-a222-abe278b92166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.762968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4e21-9454-4f08-a222-abe278b92166 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.763674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4e21-9454-4f08-a222-abe278b92166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.764743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d4e21-9454-4f08-a222-abe278b92166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.777176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4e21-9454-4f08-a222-abe278b92166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.778652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d4e21-9454-4f08-a222-abe278b92166 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.790021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1051/2128] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:47:18.849307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.849669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.851494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.879225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] MFA Rules not processed for user `bcaa4a7ea30242128c78eee9c2c73dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.881230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.956908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1078/2129] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/users => generated 293 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:47:18.956908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.967078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1052/2130] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:18.973499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38237a1-4791-4d50-9854-acb206ac8dc1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.987935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.988662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.989087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.989376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.990235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.002233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.010113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1079/2131] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:47:19.014047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.028218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e107-6240-41cc-806b-6902b68ec82a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.033928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdcff3-231a-4820-8eed-208dec4ec4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.036866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdcff3-231a-4820-8eed-208dec4ec4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.036866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdcff3-231a-4820-8eed-208dec4ec4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.036866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdcff3-231a-4820-8eed-208dec4ec4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.036866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdcff3-231a-4820-8eed-208dec4ec4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.037978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdcff3-231a-4820-8eed-208dec4ec4ec admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.049969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1053/2132] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:19.054401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.065896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba34dbb-bb7b-4590-9a91-dcc552c2f5c1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.072560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.073670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.073966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.074308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] PATH_INFO: `/v3/projects/81d1c70cf08443ca991a871679cec188/users/f1d398f50b7249e7a40beac2e3a8aa52/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.093350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d1c70cf08443ca991a871679cec188, user_id=f1d398f50b7249e7a40beac2e3a8aa52, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.099940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.170912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:19.222055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1080/2133] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:19 2022] PUT /identity/v3/projects/81d1c70cf08443ca991a871679cec188/users/f1d398f50b7249e7a40beac2e3a8aa52/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:19.223960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.224255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.224599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.266569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] MFA Rules not processed for user `f1d398f50b7249e7a40beac2e3a8aa52`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:19.268548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:19.344896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1054/2134] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:19.349818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.473172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb3f5-d162-47fb-9e09-59b136cd9bf7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.478160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.478835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.479144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.479422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.480136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.482091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.536411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:19.652178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1081/2135] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:19 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:19.656392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.668669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd58a0-cd5b-416d-a08e-0fc5071b4c39 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.737123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.738079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.738430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.738777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.739778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.742780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.876943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1055/2136] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:19 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:19.880568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.894378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fda24-bf25-4600-8230-5b6ea7b4866b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.899745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.908008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.908570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.908874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.909783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.911542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.926978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1082/2137] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:19.928329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.940164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87610f-eb98-4d79-b52f-b6ccc727cc5b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.944975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.945996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.946287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.946573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] PATH_INFO: `/v3/projects/24652d0a03354f6aa8d0095fb844e106/users/cb3718cc399f40c7ab6025807124dce3/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.965773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24652d0a03354f6aa8d0095fb844e106, user_id=cb3718cc399f40c7ab6025807124dce3, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.968563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:20.056596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1056/2138] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:19 2022] PUT /identity/v3/projects/24652d0a03354f6aa8d0095fb844e106/users/cb3718cc399f40c7ab6025807124dce3/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:20.060484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:20.072113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac97d26-671f-4c85-8e7f-9cfe2f3a7af9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:20.133954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c679a4-9314-4d16-a662-c28363001143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:20.134724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c679a4-9314-4d16-a662-c28363001143 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.135007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c679a4-9314-4d16-a662-c28363001143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.135317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c679a4-9314-4d16-a662-c28363001143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.136047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c679a4-9314-4d16-a662-c28363001143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:20.137673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c679a4-9314-4d16-a662-c28363001143 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:20.148190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1083/2139] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:20.152435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:20.163461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bf67-c9c8-4da0-a9f4-d3fb5567ce91 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:20.168590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:20.169555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.173895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.173895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] PATH_INFO: `/v3/projects/24652d0a03354f6aa8d0095fb844e106/users/cb3718cc399f40c7ab6025807124dce3/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.173895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24652d0a03354f6aa8d0095fb844e106, user_id=cb3718cc399f40c7ab6025807124dce3, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:20.174934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:20.185616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1057/2140] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:20 2022] PUT /identity/v3/projects/24652d0a03354f6aa8d0095fb844e106/users/cb3718cc399f40c7ab6025807124dce3/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:20.196204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.196500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.196785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.229174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] MFA Rules not processed for user `cb3718cc399f40c7ab6025807124dce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:20.230714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:20.327937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1084/2141] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:20.338814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:20.340798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:20.406336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650d7b-4b2c-4f3b-9f8f-a6fa16c7ba82 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:20.410771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d92563-ad80-44fa-83d1-f900f91425b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:20.411708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d92563-ad80-44fa-83d1-f900f91425b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.411964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d92563-ad80-44fa-83d1-f900f91425b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.412259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d92563-ad80-44fa-83d1-f900f91425b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.421909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d92563-ad80-44fa-83d1-f900f91425b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:20.423399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d92563-ad80-44fa-83d1-f900f91425b1 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:20.433618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1058/2142] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:20.503545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:20.643772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2e07-177d-4c5b-90ad-109e9189e5a1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:20.652998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:20.653886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.654337 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.655303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] PATH_INFO: `/v3/users/f1d398f50b7249e7a40beac2e3a8aa52` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.659487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d398f50b7249e7a40beac2e3a8aa52)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:20.661482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:20.906752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:20.926423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d398f50b7249e7a40beac2e3a8aa52'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:20.927123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d398f50b7249e7a40beac2e3a8aa52'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:20.927747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d398f50b7249e7a40beac2e3a8aa52'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:20.941110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d398f50b7249e7a40beac2e3a8aa52'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:20.949543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d398f50b7249e7a40beac2e3a8aa52'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:21.029453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1085/2143] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:20 2022] DELETE /identity/v3/users/f1d398f50b7249e7a40beac2e3a8aa52 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:21.034418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:21.034756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:21.035039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:21.056874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:21.058091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:21.143121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1059/2144] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:21.158556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:21.158556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:21.219814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502bb1b-45f1-419f-a120-d907bd9a4801 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:21.224601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:21.226326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:21.226612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:21.226892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:21.239840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:21.241377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:21.253004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1086/2145] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:47:21.684398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:21.761936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:21.765163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:21.781397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c54a83-2ac7-4ac5-a9ed-4dd05c9ae6e7 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:21.787894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:21.789104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:21.790945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:21.790945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] PATH_INFO: `/v3/projects/81d1c70cf08443ca991a871679cec188` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:21.792142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d1c70cf08443ca991a871679cec188)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:21.794654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:21.974559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d1c70cf08443ca991a871679cec188', 'request_id': 'req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:21.981462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:21.983186 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d1c70cf08443ca991a871679cec188', 'request_id': 'req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:21.991015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d1c70cf08443ca991a871679cec188', 'request_id': 'req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.089251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] The token cache is being invalidate because project 81d1c70cf08443ca991a871679cec188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:22.089539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.090381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.097125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1060/2146] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:21 2022] DELETE /identity/v3/projects/81d1c70cf08443ca991a871679cec188 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:22.098413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:22.114920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b498f-90df-44f7-b2af-fe187a4007ae service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:22.214106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:22.215430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:22.216006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:22.216610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] PATH_INFO: `/v3/users/cb3718cc399f40c7ab6025807124dce3` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:22.218389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3718cc399f40c7ab6025807124dce3)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:22.222493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:22.474321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3718cc399f40c7ab6025807124dce3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.475011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3718cc399f40c7ab6025807124dce3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.475708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3718cc399f40c7ab6025807124dce3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.500400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3718cc399f40c7ab6025807124dce3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.509283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ab39f8d3-2f07-4537-a4d1-05eea2f3473b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3718cc399f40c7ab6025807124dce3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:22.619393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1087/2147] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:22 2022] DELETE /identity/v3/users/cb3718cc399f40c7ab6025807124dce3 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:23.553390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:23.894513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:23.896724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:23.924493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a24e-bed2-49a9-aec3-2c0148c9aa1f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:23.974504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:23.975416 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:23.975700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:23.975977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] PATH_INFO: `/v3/projects/24652d0a03354f6aa8d0095fb844e106` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:23.977212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24652d0a03354f6aa8d0095fb844e106)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:23.979176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:24.188633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24652d0a03354f6aa8d0095fb844e106', 'request_id': 'req-1a71cfc6-252c-48fc-9956-ecf459872a63'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:24.194375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24652d0a03354f6aa8d0095fb844e106', 'request_id': 'req-1a71cfc6-252c-48fc-9956-ecf459872a63'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:24.200649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24652d0a03354f6aa8d0095fb844e106', 'request_id': 'req-1a71cfc6-252c-48fc-9956-ecf459872a63'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:24.393459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] The token cache is being invalidate because project 24652d0a03354f6aa8d0095fb844e106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:24.393459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:24.393459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-1a71cfc6-252c-48fc-9956-ecf459872a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:24.394697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1061/2148] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:23 2022] DELETE /identity/v3/projects/24652d0a03354f6aa8d0095fb844e106 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:24.395746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:24.397568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:24.397751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:24.417663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:24.419420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:24.490658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1088/2149] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:24.498869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:24.499311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:24.499609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:24.528042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:24.529913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:24.541502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1062/2150] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:24.546065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:24.565750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2770deb-ed96-49e1-bf48-36bcd1f82206 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:24.590441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:24.591461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:24.591745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:24.592797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:24.594796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:47:24.595764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:24.597950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:24.618254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1089/2151] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:47:24.619783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:24.631250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a9a7-1cd1-45cf-aafa-abcc9074eeb2 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:24.640224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:24.640910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:24.641191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:24.641468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:24.642972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:24.644974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:24.859419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1063/2152] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:24 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:24.864821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:24.885577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618f4c-7505-496a-832a-745e6d9082c1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:25.030356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:25.032072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:25.033636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:25.034184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:25.037688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:25.042838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:25.170158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1090/2153] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:24 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:25.174565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:25.187166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d07160-f2be-41f6-91bf-2dabe0ca0224 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:25.194372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:25.195446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:25.196156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:25.196688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:25.197799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:25.199885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:25.227177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1064/2154] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:25.239016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:25.245304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582922-6413-47ea-964e-a17dce90d218 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:25.251012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fa4ba-7980-45eb-90b8-0de0e11a780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:25.252548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fa4ba-7980-45eb-90b8-0de0e11a780e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:25.253064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fa4ba-7980-45eb-90b8-0de0e11a780e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:25.253190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fa4ba-7980-45eb-90b8-0de0e11a780e admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:25.253866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fa4ba-7980-45eb-90b8-0de0e11a780e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:25.255763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fa4ba-7980-45eb-90b8-0de0e11a780e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:25.269308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1091/2155] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:25.272907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:25.283672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd10f38-f4ea-4e55-988e-8b9c0e1c588b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:25.290616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:25.291119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:25.291535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:25.292058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] PATH_INFO: `/v3/projects/2820d387d798445891504f1fbc44f1c1/users/accc42a2a37c44709d295f600964521a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:25.307319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:25.312857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2820d387d798445891504f1fbc44f1c1, user_id=accc42a2a37c44709d295f600964521a, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:25.317828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:25.438103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1065/2156] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:25 2022] PUT /identity/v3/projects/2820d387d798445891504f1fbc44f1c1/users/accc42a2a37c44709d295f600964521a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:25.441080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:25.441382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:25.441664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:25.478104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] MFA Rules not processed for user `accc42a2a37c44709d295f600964521a`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:25.479359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:25.587478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1092/2157] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:25.591463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:25.751801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da0a40-cfa1-495f-aee9-9ba5d882d5e3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:25.786412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:25.786412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:25.786412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:25.786412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:25.786851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:25.786851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:25.941142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1066/2158] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:25 2022] POST /identity/v3/projects => generated 387 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:47:25.948026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:25.963601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02f3b9-c4d1-44f4-b658-ddf55bd8e14e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.079765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.080534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.080836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.081162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.081878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.084028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.187736 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1093/2159] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:25 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:47:26.192381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.203145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876459ab-f691-478d-923e-c723e056fe18 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.208426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.209803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.210099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.210348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.211084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.212720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.224577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1067/2160] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:26.228977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.244196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1694-56ae-4320-8eff-efdbd7035985 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.250545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.252074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.252353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.252629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] PATH_INFO: `/v3/projects/fa586b4cc38744b7bd4f66d4d561d8f3/users/67c190cacef64eb6a7429a0f66703a2b/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.269631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa586b4cc38744b7bd4f66d4d561d8f3, user_id=67c190cacef64eb6a7429a0f66703a2b, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.272663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.412001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1094/2161] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:26 2022] PUT /identity/v3/projects/fa586b4cc38744b7bd4f66d4d561d8f3/users/67c190cacef64eb6a7429a0f66703a2b/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:26.416757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.428206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565850-d7c9-4669-bb16-6599364e5b89 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.503997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937d00d-cd53-4223-b1e1-fa8a47e19f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.508114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937d00d-cd53-4223-b1e1-fa8a47e19f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.508409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937d00d-cd53-4223-b1e1-fa8a47e19f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.508690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937d00d-cd53-4223-b1e1-fa8a47e19f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.509450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937d00d-cd53-4223-b1e1-fa8a47e19f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.520583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937d00d-cd53-4223-b1e1-fa8a47e19f75 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.526907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1068/2162] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:26.528231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.539204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b416008-ad49-43dd-86f5-ba3e0c6ba6e3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.546991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.548203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.548640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.549593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] PATH_INFO: `/v3/projects/fa586b4cc38744b7bd4f66d4d561d8f3/users/67c190cacef64eb6a7429a0f66703a2b/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.552090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa586b4cc38744b7bd4f66d4d561d8f3, user_id=67c190cacef64eb6a7429a0f66703a2b, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.557615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.572705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1095/2163] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:26 2022] PUT /identity/v3/projects/fa586b4cc38744b7bd4f66d4d561d8f3/users/67c190cacef64eb6a7429a0f66703a2b/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:26.583592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ed41-84d6-4286-b761-fe5462e2476f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.583895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ed41-84d6-4286-b761-fe5462e2476f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.584253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ed41-84d6-4286-b761-fe5462e2476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.620903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7972ed41-84d6-4286-b761-fe5462e2476f None None] MFA Rules not processed for user `67c190cacef64eb6a7429a0f66703a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:26.622470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7972ed41-84d6-4286-b761-fe5462e2476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:26.734679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1069/2164] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:26.748305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.749420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:26.778689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.778978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.779281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.779403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:26.816432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] MFA Rules not processed for user `e6ed5088d3494139b93a7d2af4b48a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:26.817721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:26.836651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd33ba-c2d4-4d1b-9176-538827547cc1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.840353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.841061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.841347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.841625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.851227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.852781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.863595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1096/2165] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:26.886548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1070/2166] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:26.891199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.894299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:26.959381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54bf19-0c15-4b43-a972-18d338a07da1 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.964106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.967643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.967643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.967643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.967643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.968344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:27.115464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1097/2167] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:47:26 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:27.119947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:27.131898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8de2-8f2d-4c37-bf11-f8899fbf46fb None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:27.191591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:27.192280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:27.192566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:27.193113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:27.193547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:27.195562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:27.285228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1071/2168] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:47:27 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:47:27.289997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:27.301347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b531-51d8-47a1-b8d6-f7dedd826c6f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:27.306288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:27.306968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:27.307301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:27.307583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:27.308330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:27.310027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:27.325732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1098/2169] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:27.326935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:27.337674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7b09-6e46-40a7-af04-4be6c9d4c651 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:27.344574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:27.346068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:27.347469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:27.347763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] PATH_INFO: `/v3/projects/7f2692c1c5dc42ffb287cd92d7041b47/users/28c6ca7ad6bf49cea4b2cb8db42e4f6d/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:27.367999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2692c1c5dc42ffb287cd92d7041b47, user_id=28c6ca7ad6bf49cea4b2cb8db42e4f6d, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:27.371835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:27.480817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1072/2170] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:27 2022] PUT /identity/v3/projects/7f2692c1c5dc42ffb287cd92d7041b47/users/28c6ca7ad6bf49cea4b2cb8db42e4f6d/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:27.484438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:27.501104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58864-0b86-4463-8232-a6da56294d7e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:27.593496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:27.594233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:27.598104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:27.598104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:27.598104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:27.598104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:27.612443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1099/2171] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:47:27.617681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:27.631027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89874-21a5-481a-8f4d-5d51f499f496 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:27.638686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841631f-a277-4fa3-8515-663602a09c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:27.645174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841631f-a277-4fa3-8515-663602a09c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:27.645528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841631f-a277-4fa3-8515-663602a09c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:27.645816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841631f-a277-4fa3-8515-663602a09c0b admin admin] PATH_INFO: `/v3/projects/7f2692c1c5dc42ffb287cd92d7041b47/users/28c6ca7ad6bf49cea4b2cb8db42e4f6d/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:27.651211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841631f-a277-4fa3-8515-663602a09c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2692c1c5dc42ffb287cd92d7041b47, user_id=28c6ca7ad6bf49cea4b2cb8db42e4f6d, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:27.658671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841631f-a277-4fa3-8515-663602a09c0b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:27.690812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1073/2172] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:47:27 2022] PUT /identity/v3/projects/7f2692c1c5dc42ffb287cd92d7041b47/users/28c6ca7ad6bf49cea4b2cb8db42e4f6d/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:28.004128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:28.354709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:28.377110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c15c3-4891-4b51-853a-ff42095d0e54 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:28.441677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:28.442558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:28.450519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:28.450519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] PATH_INFO: `/v3/users/accc42a2a37c44709d295f600964521a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:28.450519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] RBAC: Authorizing `identity:delete_user(user_id=accc42a2a37c44709d295f600964521a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:28.450519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:28.767591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accc42a2a37c44709d295f600964521a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:28.769407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accc42a2a37c44709d295f600964521a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:28.770820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accc42a2a37c44709d295f600964521a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:28.793130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accc42a2a37c44709d295f600964521a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:28.813186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accc42a2a37c44709d295f600964521a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:28.942718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1100/2173] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:28 2022] DELETE /identity/v3/users/accc42a2a37c44709d295f600964521a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:28.948085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:28.949187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:28.949819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:28.975771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:28.977738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:29.066977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1074/2174] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:29.077390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:29.081690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:29.198225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b991-cbc4-4c7a-81f8-f803a695120e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:29.203755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:29.205871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:29.206330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:29.206975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:29.229145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:29.232962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:29.253508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1101/2175] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:29.256267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:29.821345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:30.091281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:30.096069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:30.107604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b48d9-6073-42c3-9da4-557e0829cdca None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:30.115790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:30.116533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:30.116812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:30.117282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] PATH_INFO: `/v3/projects/2820d387d798445891504f1fbc44f1c1` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:30.118504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2820d387d798445891504f1fbc44f1c1)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:30.129995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:30.285250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2820d387d798445891504f1fbc44f1c1', 'request_id': 'req-47cf04e1-c043-4541-90b7-ee6def1fca73'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.296508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2820d387d798445891504f1fbc44f1c1', 'request_id': 'req-47cf04e1-c043-4541-90b7-ee6def1fca73'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.315042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2820d387d798445891504f1fbc44f1c1', 'request_id': 'req-47cf04e1-c043-4541-90b7-ee6def1fca73'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.386472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] The token cache is being invalidate because project 2820d387d798445891504f1fbc44f1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:30.387053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.388340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.393866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1075/2176] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:30 2022] DELETE /identity/v3/projects/2820d387d798445891504f1fbc44f1c1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:30.395748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:30.410088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7e50b-2502-41cf-afaa-e93aef2a7ef4 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:30.543200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:30.548680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:30.548680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:30.548680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] PATH_INFO: `/v3/users/67c190cacef64eb6a7429a0f66703a2b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:30.551318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c190cacef64eb6a7429a0f66703a2b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:30.553545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:30.787808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:30.859713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c190cacef64eb6a7429a0f66703a2b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.865679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c190cacef64eb6a7429a0f66703a2b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.865679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c190cacef64eb6a7429a0f66703a2b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.891067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c190cacef64eb6a7429a0f66703a2b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.902869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-28d16762-b828-4c61-81a7-396cf01756cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c190cacef64eb6a7429a0f66703a2b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:30.986871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1102/2177] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:47:30 2022] DELETE /identity/v3/users/67c190cacef64eb6a7429a0f66703a2b => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:47:31.675315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:31.676176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:31.702736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf04e1-c043-4541-90b7-ee6def1fca73 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:31.894958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:31.899515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:31.903222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:31.903815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] PATH_INFO: `/v3/projects/fa586b4cc38744b7bd4f66d4d561d8f3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:31.905387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa586b4cc38744b7bd4f66d4d561d8f3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:31.911083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:32.097560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa586b4cc38744b7bd4f66d4d561d8f3', 'request_id': 'req-6c1cdfc9-ed55-4243-84c7-1080ffee6646'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:32.104816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:32.111370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa586b4cc38744b7bd4f66d4d561d8f3', 'request_id': 'req-6c1cdfc9-ed55-4243-84c7-1080ffee6646'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:32.122897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa586b4cc38744b7bd4f66d4d561d8f3', 'request_id': 'req-6c1cdfc9-ed55-4243-84c7-1080ffee6646'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:32.186146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:32.187012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:32.191471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:32.268418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] MFA Rules not processed for user `606ff49786a04aa5b677cbb9a57b216c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:32.270038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:32.292696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] The token cache is being invalidate because project fa586b4cc38744b7bd4f66d4d561d8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:47:32.293176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:32.294581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6c1cdfc9-ed55-4243-84c7-1080ffee6646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:47:32.296611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1076/2178] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:47:31 2022] DELETE /identity/v3/projects/fa586b4cc38744b7bd4f66d4d561d8f3 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:47:32.393780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1103/2179] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:32.527793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:34.478453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:35.372586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f86ac-5c10-457d-b9e7-15c50a506d4b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.373086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f86ac-5c10-457d-b9e7-15c50a506d4b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.373086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f86ac-5c10-457d-b9e7-15c50a506d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.412025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-257f86ac-5c10-457d-b9e7-15c50a506d4b None None] MFA Rules not processed for user `28c6ca7ad6bf49cea4b2cb8db42e4f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:35.413267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-257f86ac-5c10-457d-b9e7-15c50a506d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:35.517785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1077/2180] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:35.532219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:35.534069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:35.689977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b764-74f4-4e12-969e-b05fb78fcf51 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:35.697256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:35.698220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.698510 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.698787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.700715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:35.793649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:35.794823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:35.806225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1104/2181] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:47:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:39.269535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b0df-c062-411c-bc9b-26f7f441e1ea None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:39.269989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b0df-c062-411c-bc9b-26f7f441e1ea None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:39.270112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b0df-c062-411c-bc9b-26f7f441e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:39.292821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-dbb8b0df-c062-411c-bc9b-26f7f441e1ea None None] MFA Rules not processed for user `e6ed5088d3494139b93a7d2af4b48a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:39.294652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dbb8b0df-c062-411c-bc9b-26f7f441e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:39.306171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1078/2182] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:46.261311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:49.284464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=43,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:03.249898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:03.251321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:03.342462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa034a1-8df8-4317-83b0-6daf0366997b service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:03.347839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:03.348472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:03.348752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:03.349026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:03.350786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:03.361983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:03.364161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:03.374247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1105/2183] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:48:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:04.815231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a777a-564f-489e-afb1-4aa4a431f3f9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:04.815760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a777a-564f-489e-afb1-4aa4a431f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:04.815867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a777a-564f-489e-afb1-4aa4a431f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:04.865741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-cf3a777a-564f-489e-afb1-4aa4a431f3f9 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:04.866960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cf3a777a-564f-489e-afb1-4aa4a431f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:04.933138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1079/2184] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:05.055458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:05.055930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:05.149878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e81e-d058-4e09-98de-d5cf720d6985 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:05.155003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefde7d8-caef-47c9-b1c3-d65e5a553c7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:05.155687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde7d8-caef-47c9-b1c3-d65e5a553c7e service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:05.155970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde7d8-caef-47c9-b1c3-d65e5a553c7e service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:05.156247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde7d8-caef-47c9-b1c3-d65e5a553c7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:05.165564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefde7d8-caef-47c9-b1c3-d65e5a553c7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:05.167188 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefde7d8-caef-47c9-b1c3-d65e5a553c7e service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:05.175570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1106/2185] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:48:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:48:14.930126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=40 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:15.172321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=82 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:18.925640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:18.927255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:18.927717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:18.947853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] MFA Rules not processed for user `72deeff329a6482cbfdb828a1996b127`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:18.949353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:19.015528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1080/2186] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:26.588006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:26.588479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:26.588568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:26.605603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:26.606820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:26.614480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1107/2187] 10.222.0.32 () {58 vars in 967 bytes} [Mon May 23 15:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:26.626932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:26.639660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9558-de54-44d9-931e-04523f27c18c None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:26.644665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:26.645339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:26.645623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:26.645902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:26.654252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:26.655881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:26.664183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1081/2188] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:48:29.754373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:29.756559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:29.825443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90fab-a8cc-4e27-8b10-70c90157ed6d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:29.830275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:29.831245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:29.831531 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:29.831816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] PATH_INFO: `/v3/users/bcaa4a7ea30242128c78eee9c2c73dfe` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:29.833100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcaa4a7ea30242128c78eee9c2c73dfe)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:29.835073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:30.012225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcaa4a7ea30242128c78eee9c2c73dfe'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.012904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcaa4a7ea30242128c78eee9c2c73dfe'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.013505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcaa4a7ea30242128c78eee9c2c73dfe'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.025915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcaa4a7ea30242128c78eee9c2c73dfe'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.033661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d70b77de-c3b9-43f1-8fc4-d192a12e0d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcaa4a7ea30242128c78eee9c2c73dfe'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.123116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1108/2189] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:48:29 2022] DELETE /identity/v3/users/bcaa4a7ea30242128c78eee9c2c73dfe => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:48:30.395745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:30.411950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453690e-9872-4307-b1ea-48e999c673a4 service swift] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:30.474685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:30.475588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.475963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.476259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] PATH_INFO: `/v3/projects/b0c39de631f44292b3b0875386f17f3f` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.477384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c39de631f44292b3b0875386f17f3f)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:30.479330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:30.611432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c39de631f44292b3b0875386f17f3f', 'request_id': 'req-f2e492ef-60c6-407f-a23b-000acd57239d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.617913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c39de631f44292b3b0875386f17f3f', 'request_id': 'req-f2e492ef-60c6-407f-a23b-000acd57239d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.624974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c39de631f44292b3b0875386f17f3f', 'request_id': 'req-f2e492ef-60c6-407f-a23b-000acd57239d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.746473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] The token cache is being invalidate because project b0c39de631f44292b3b0875386f17f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:48:30.748068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.748068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-f2e492ef-60c6-407f-a23b-000acd57239d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:48:30.749292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1082/2190] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:48:30 2022] DELETE /identity/v3/projects/b0c39de631f44292b3b0875386f17f3f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:48:30.754718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.755281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.755507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.774401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:30.776777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:30.839733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1109/2191] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:30.847598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.847917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.848200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.868089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:30.869322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:30.878569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1083/2192] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:30.883708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:30.896014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88673e86-41ba-4bee-ad84-17fef956071e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:30.901059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:30.901887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.902178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.902461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.903235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:48:30.903552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:30.905186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:30.916476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:30.920086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1110/2193] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:48:30.924523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:30.935617 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411dad-9bf5-4c8c-b126-b97bfeb774a0 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:30.940583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:30.941449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.941736 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.942154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.942874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:30.944908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:30.960700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:31.085600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1084/2194] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:48:30 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:48:31.091270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:31.103120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f467-50da-4e20-9f0a-194d974899ac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:31.165720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:31.166400 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.166688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.166970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.167704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:31.170153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:31.260920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1111/2195] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:48:31 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:48:31.269876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:31.283430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620ff09-66e8-45b8-b0e9-666b5178c987 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:31.289685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:31.290861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.291054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.291447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.292726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:31.294340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:31.307506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1085/2196] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:48:31.312235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:31.326850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a1d44-c659-4b32-bf7e-55d24f606019 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:31.335706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3df298-ae3a-4357-916d-1d5a16a7c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:31.336389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df298-ae3a-4357-916d-1d5a16a7c387 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.336675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df298-ae3a-4357-916d-1d5a16a7c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.337030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df298-ae3a-4357-916d-1d5a16a7c387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.337926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3df298-ae3a-4357-916d-1d5a16a7c387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:31.341191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3df298-ae3a-4357-916d-1d5a16a7c387 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:31.355787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1112/2197] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:48:31.359304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:31.370829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefb5e3-8e31-4c03-a930-ad368dc67d8f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:31.375738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:31.376612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.376922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.377198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] PATH_INFO: `/v3/projects/4fc6b6c61b114f1fa13cb4fe1c2a4d6a/users/2251df55cfa147538f6560dbe35ab41d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.391975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc6b6c61b114f1fa13cb4fe1c2a4d6a, user_id=2251df55cfa147538f6560dbe35ab41d, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:31.395413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:31.502563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1086/2198] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:48:31 2022] PUT /identity/v3/projects/4fc6b6c61b114f1fa13cb4fe1c2a4d6a/users/2251df55cfa147538f6560dbe35ab41d/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:48:31.513754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a3de-d730-49da-a05d-5bd6acf1e78d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.514529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a3de-d730-49da-a05d-5bd6acf1e78d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.514529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a3de-d730-49da-a05d-5bd6acf1e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.547895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-6585a3de-d730-49da-a05d-5bd6acf1e78d None None] MFA Rules not processed for user `2251df55cfa147538f6560dbe35ab41d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:31.549217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6585a3de-d730-49da-a05d-5bd6acf1e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:31.624421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1113/2199] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:31.636503 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:31.638336 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:31.735823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c122e4-2677-4dd4-bd18-80b7d88cde25 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:31.740783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:31.741663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.742088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.742527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.753489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:31.756082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:31.773647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1087/2200] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:48:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:48:41.643998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:41.761974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:INSERT=2,keystone:SELECT=52 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:08.180605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:08.181165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:08.181284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:08.200650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:08.201867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:08.264433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1114/2201] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:49:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:49:08.288900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:08.290301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:08.359229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68960f6-88fc-41d3-82f9-0f90ee60c90d service glance] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:08.365156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:08.365820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:08.366108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:08.366388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:08.375907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:08.377588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:08.386706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1088/2202] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:49:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:49:18.257186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=25 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:18.383276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=32 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:29.195163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:29.196734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:29.261728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae36e0-09c8-4889-8d39-bcb9517a1217 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:29.265316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:29.266001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:29.266251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:29.266530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:29.268333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:29.342870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:29.344313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f7db6-1cb7-4a66-ae82-6ac6ce7abe58 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:29.357809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1115/2203] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:34.107895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:34.175406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5afa3-8c9a-4f3a-8149-018b57445d63 service swift] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:34.179880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:34.180760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:34.181043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:34.181316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] PATH_INFO: `/v3/users/2251df55cfa147538f6560dbe35ab41d` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:34.182647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2251df55cfa147538f6560dbe35ab41d)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:34.184598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:34.405971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2251df55cfa147538f6560dbe35ab41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:34.465815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2251df55cfa147538f6560dbe35ab41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:34.466439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2251df55cfa147538f6560dbe35ab41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:34.479460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2251df55cfa147538f6560dbe35ab41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:34.487831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2251df55cfa147538f6560dbe35ab41d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:34.494594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1089/2204] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 15:49:34 2022] DELETE /identity/v3/users/2251df55cfa147538f6560dbe35ab41d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:49:34.499743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:34.500286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:34.500286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:34.520824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:34.522039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:34.581399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1116/2205] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:34.591539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:34.592976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:34.650816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c943-cd73-4c13-950d-8a750de93c2f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:34.654417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fe67-e098-43cc-87de-81c1e8457814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:34.655063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fe67-e098-43cc-87de-81c1e8457814 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:34.661567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fe67-e098-43cc-87de-81c1e8457814 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:34.661567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fe67-e098-43cc-87de-81c1e8457814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:34.664700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fe67-e098-43cc-87de-81c1e8457814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:34.666125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fe67-e098-43cc-87de-81c1e8457814 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:34.675581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1090/2206] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:35.106625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.108048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:35.121293 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f8234-3bd1-41cb-9daf-859b67e8af6c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.128815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.129874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.130169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.130492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] PATH_INFO: `/v3/projects/4fc6b6c61b114f1fa13cb4fe1c2a4d6a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.131939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc6b6c61b114f1fa13cb4fe1c2a4d6a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:35.137344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:35.237660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:35.241285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc6b6c61b114f1fa13cb4fe1c2a4d6a', 'request_id': 'req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:35.346169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc6b6c61b114f1fa13cb4fe1c2a4d6a', 'request_id': 'req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:35.353491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc6b6c61b114f1fa13cb4fe1c2a4d6a', 'request_id': 'req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:35.366174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] The token cache is being invalidate because project 4fc6b6c61b114f1fa13cb4fe1c2a4d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:49:35.366463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:35.367152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f154c4b4-c5fc-4894-ba5f-2e8b90f5c4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:49:35.368712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1117/2207] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 15:49:35 2022] DELETE /identity/v3/projects/4fc6b6c61b114f1fa13cb4fe1c2a4d6a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:49:35.374231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.374703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.374809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.393577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:35.395349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:35.415931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:35.461831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1091/2208] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:35.469179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.469477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.469761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.489426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:35.490728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:35.499406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1118/2209] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:35.504305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.513698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b09e7-aa9a-47bd-99df-84f05bace18d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.519084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.520320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.520698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.520869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.521606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:49:35.521912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:35.523569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:35.541345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1092/2210] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:49:35.546727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.556249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfaa68-d9d7-4cb9-8e16-e2f9371b2752 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.562027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.562690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.562978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.563308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.564027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:35.566092 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:35.707781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1119/2211] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:49:35.714266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.724827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5d34-68d0-4954-9720-a7db938cbc4a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.780217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.780882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.781167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.781442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.782129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:35.784067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:35.895564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1093/2212] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:49:35 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:49:35.899592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.910160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca661a-52e0-42ab-af75-5e845e935c41 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.914623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.915310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.915598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.915876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.916610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:35.918216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:35.928683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1120/2213] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:49:35.932554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.942939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b03b2-f5f8-4cd4-aae0-810c1bf0a463 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.947498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8b11d-785b-4de1-893e-927ea9c97110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.948152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b11d-785b-4de1-893e-927ea9c97110 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.948449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b11d-785b-4de1-893e-927ea9c97110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.948707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b11d-785b-4de1-893e-927ea9c97110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.949694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8b11d-785b-4de1-893e-927ea9c97110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:35.951371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8b11d-785b-4de1-893e-927ea9c97110 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:35.963069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1094/2214] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:49:35.967748 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:35.978345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45cfa8-0a96-42cf-b1de-58902901a1d7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:35.982909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:35.983880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:35.984167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:35.984444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] PATH_INFO: `/v3/projects/8ce8b36a28714d618becacd8e2925a75/users/16a2ff4a80da41bf84f19450000a9da1/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:35.998699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce8b36a28714d618becacd8e2925a75, user_id=16a2ff4a80da41bf84f19450000a9da1, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:36.001755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:36.072233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1121/2215] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:49:35 2022] PUT /identity/v3/projects/8ce8b36a28714d618becacd8e2925a75/users/16a2ff4a80da41bf84f19450000a9da1/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:49:36.077397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8573a80-6f4f-4dfb-b8a2-685b344be56b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:36.077777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8573a80-6f4f-4dfb-b8a2-685b344be56b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:36.078121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8573a80-6f4f-4dfb-b8a2-685b344be56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:36.097288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d8573a80-6f4f-4dfb-b8a2-685b344be56b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:36.098564 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d8573a80-6f4f-4dfb-b8a2-685b344be56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:36.156154 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1095/2216] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:36.165501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:36.167237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:36.222724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf764f-7a79-4ad5-b758-3298d1e5421f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:36.226334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6a67a-40c8-42a6-8253-68633a2e9075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:36.227088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a67a-40c8-42a6-8253-68633a2e9075 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:36.227396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a67a-40c8-42a6-8253-68633a2e9075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:36.227698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a67a-40c8-42a6-8253-68633a2e9075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:36.237198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6a67a-40c8-42a6-8253-68633a2e9075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:36.239221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6a67a-40c8-42a6-8253-68633a2e9075 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:36.248610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1122/2217] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:42.583625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e879-b4a3-4c0d-ac70-32f369c0613a None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:42.583625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e879-b4a3-4c0d-ac70-32f369c0613a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:42.584339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e879-b4a3-4c0d-ac70-32f369c0613a None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:42.585625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1096/2218] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:42.599760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1115e6-1f56-4f74-bcbf-23108092d790 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:42.601383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1115e6-1f56-4f74-bcbf-23108092d790 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:42.602248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1115e6-1f56-4f74-bcbf-23108092d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:42.649497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9e1115e6-1f56-4f74-bcbf-23108092d790 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:42.651067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9e1115e6-1f56-4f74-bcbf-23108092d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:42.711828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:42.729509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1123/2219] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:49:42.743038 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e879-b4a3-4c0d-ac70-32f369c0613a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:42.745093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1da6e879-b4a3-4c0d-ac70-32f369c0613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:42.801771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:42.828454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e879-b4a3-4c0d-ac70-32f369c0613a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:42.832310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:42.833145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:42.833435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:42.833710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:42.848276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:42.854585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ef28-aabe-40c9-afe6-07b87fe340fd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:42.854585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ef28-aabe-40c9-afe6-07b87fe340fd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:42.854585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ef28-aabe-40c9-afe6-07b87fe340fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:42.854885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:42.861392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1097/2220] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:42.877920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2cd4ef28-aabe-40c9-afe6-07b87fe340fd None None] MFA Rules not processed for user `16a2ff4a80da41bf84f19450000a9da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:42.879710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2cd4ef28-aabe-40c9-afe6-07b87fe340fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:42.969447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1124/2221] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:42.973973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:42.984405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ec251-bb91-4514-b6f5-0bffb5a76fd0 service glance] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:42.989942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:42.990610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:42.990948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:42.991278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:42.991988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:42.994666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.109646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d44fbd-1498-4471-93dd-180f26a6fd96 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.109920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d44fbd-1498-4471-93dd-180f26a6fd96 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.110195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d44fbd-1498-4471-93dd-180f26a6fd96 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.111790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1125/2222] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:43.117281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.117908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1098/2223] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 15:49:42 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:49:43.118041 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.118267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.118659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.139363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:43.141039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:43.190755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894b870-659f-4d93-81c8-75a0dc938a2a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.195596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88413af0-fc4e-48b2-9508-d04554f7d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.196296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413af0-fc4e-48b2-9508-d04554f7d17b admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.196591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413af0-fc4e-48b2-9508-d04554f7d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.196869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413af0-fc4e-48b2-9508-d04554f7d17b admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.197575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88413af0-fc4e-48b2-9508-d04554f7d17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.199537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88413af0-fc4e-48b2-9508-d04554f7d17b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.203766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1126/2224] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:43.215914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.234657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943019a1-c780-4469-895c-2049d7b03ac5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.238265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.240040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.240040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.240442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.249442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.250986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.259785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1127/2225] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:49:43.328977 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1099/2226] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 15:49:43 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:49:43.332815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.344823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eff6d-4713-4876-bbf3-16838a707b5d None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.345117 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eff6d-4713-4876-bbf3-16838a707b5d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.345399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eff6d-4713-4876-bbf3-16838a707b5d None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.345944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0f8f-40f4-41ff-9177-53487efbecc4 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.346996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1100/2227] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 15:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:43.351063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.351752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.352170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.352448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.353182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.354793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.358202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.358614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.358994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.366499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1128/2228] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:49:43.370395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.380628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d089-1e2b-423a-8ad5-210d66c806d4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.382920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:43.384223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:43.385259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.386130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.386412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.386687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] PATH_INFO: `/v3/projects/f59a265b4d6545a8a4176f5aa3501c92/users/a26592919a114f4d8316ef99403ef798/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.408944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a265b4d6545a8a4176f5aa3501c92, user_id=a26592919a114f4d8316ef99403ef798, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.412952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.458880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1101/2229] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:49:43.469250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.480142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8211ef-958e-4eb5-8e25-09f5b63be83b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.484113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.491441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.491441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.491441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.501635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.503302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.523795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1102/2230] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:49:43.526798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1129/2231] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:49:43 2022] PUT /identity/v3/projects/f59a265b4d6545a8a4176f5aa3501c92/users/a26592919a114f4d8316ef99403ef798/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:49:43.528272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.551494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5dd1c-0eaf-4085-93ca-736b08e275e8 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.568081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:43.620857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1cdc8-8c30-4a5f-a474-a138a1f61660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.621604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1cdc8-8c30-4a5f-a474-a138a1f61660 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.621809 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1cdc8-8c30-4a5f-a474-a138a1f61660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.622094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1cdc8-8c30-4a5f-a474-a138a1f61660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.622838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1cdc8-8c30-4a5f-a474-a138a1f61660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.624795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1cdc8-8c30-4a5f-a474-a138a1f61660 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.637190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1103/2232] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 15:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:49:43.641304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:43.655082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea9ad-2f27-4bd0-ae72-45abb50b766f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:43.665709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:43.668018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:43.668312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:43.669921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] PATH_INFO: `/v3/projects/f59a265b4d6545a8a4176f5aa3501c92/users/a26592919a114f4d8316ef99403ef798/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:43.676576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a265b4d6545a8a4176f5aa3501c92, user_id=a26592919a114f4d8316ef99403ef798, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:43.680394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:43.701518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1130/2233] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 15:49:43 2022] PUT /identity/v3/projects/f59a265b4d6545a8a4176f5aa3501c92/users/a26592919a114f4d8316ef99403ef798/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:49:49.983314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3577-4fbf-4142-a929-35d3b2cdf336 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:49.983820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3577-4fbf-4142-a929-35d3b2cdf336 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:49.983910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3577-4fbf-4142-a929-35d3b2cdf336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:50.017084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-babc3577-4fbf-4142-a929-35d3b2cdf336 None None] MFA Rules not processed for user `a26592919a114f4d8316ef99403ef798`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:50.018628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-babc3577-4fbf-4142-a929-35d3b2cdf336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:50.100672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1104/2234] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:50.120292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:50.166348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:50.209447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff940860-b78c-4cb0-a91c-ed278ea1e42f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:50.213840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:50.215531 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:50.215824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:50.216301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:50.287314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:50.288799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:50.301889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1131/2235] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:49:50.642173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:50.642568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:50.642950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:50.663780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:50.665685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:50.733749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1105/2236] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:50.746765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:50.748249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:50.826758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9471-624b-4fa9-9fd5-cafd432f3fe4 service glance] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:50.832316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc037b0-c05e-4c9f-b4e4-d8a6df0da116 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:50.833103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc037b0-c05e-4c9f-b4e4-d8a6df0da116 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:50.833199 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc037b0-c05e-4c9f-b4e4-d8a6df0da116 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:50.833568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc037b0-c05e-4c9f-b4e4-d8a6df0da116 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:50.847154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc037b0-c05e-4c9f-b4e4-d8a6df0da116 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:50.849666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc037b0-c05e-4c9f-b4e4-d8a6df0da116 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:50.860254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1132/2237] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:49:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:49:53.918146 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:53.995746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:54.014906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ead6a1-a8cc-4353-8991-0cb4637a99ed None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:54.019157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:54.020389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:54.020741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:54.021079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:54.026062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:54.323063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:54.323063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:54.323063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1106/2238] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:54.696093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8eb48-1814-482c-9a75-f843ff98545b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:54.702257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8eb48-1814-482c-9a75-f843ff98545b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:54.702257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8eb48-1814-482c-9a75-f843ff98545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:54.723164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3bd8eb48-1814-482c-9a75-f843ff98545b None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:54.723164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3bd8eb48-1814-482c-9a75-f843ff98545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:54.726874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1133/2239] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:54.740737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:54.756787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c6f51-8521-41a5-9dd8-91df6dcab1e2 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:54.762184 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:54.762830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:54.763142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:54.763431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:54.779812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:54.781322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:54.801640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1107/2240] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:49:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:49:55.432857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab44c13-ee75-4085-aec4-9d0bf7a4a40f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:55.433149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab44c13-ee75-4085-aec4-9d0bf7a4a40f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:55.433435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab44c13-ee75-4085-aec4-9d0bf7a4a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:55.456854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:55.473291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8ab44c13-ee75-4085-aec4-9d0bf7a4a40f None None] MFA Rules not processed for user `cc4c3405e93141fc851f22e49eee09bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:55.479212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8ab44c13-ee75-4085-aec4-9d0bf7a4a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:55.480323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6488d6-a59c-470d-b82a-7a0a1316f104 service swift] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:55.484325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:55.485079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:55.485265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:55.485908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:55.492634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:55.523199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:55.524669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:55.557529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1108/2241] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:49:55.584892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1134/2242] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:50:03.570267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:03.572920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:03.663119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177777b5-8fad-4ce6-a28b-9676ab84b998 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:03.668304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:03.669156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:03.669452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:03.669938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:03.671938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:03.684238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:03.685837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:03.696817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1109/2243] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:03.910061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:03.910621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:03.910621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:03.928548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] MFA Rules not processed for user `16a2ff4a80da41bf84f19450000a9da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:50:03.934109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:03.937295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1135/2244] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:50:04.782993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:04.784502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:04.799880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbe47f-4b76-4824-a378-0b30a63e6b9c service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:04.806007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:04.806690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:04.807428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:04.807428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:04.810689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:04.874043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:04.890674 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:04.897671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4bbf-3887-4108-abd0-7688be8a4473 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:04.911815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1110/2245] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:13.922890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:14.996937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:16.154483 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:16.164894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae4e5-95cf-4817-8afb-de73799ee78b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:16.169079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:16.169723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:16.170008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:16.170287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:16.172108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:16.182701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:16.184178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:16.193481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1136/2246] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:22.253476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:22.254077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:22.254170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:22.272526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:50:22.273828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:22.281414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1111/2247] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 15:50:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:50:22.306539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:22.320005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad3c7-23b3-4f99-8d84-245db9469d40 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:22.325554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:22.326336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:22.326718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:22.327201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:22.337495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:22.339401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:22.350680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1137/2248] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:50:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:50:32.267267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:32.346933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=12 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:42.276294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:42.276294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:42.291339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098f77-dc16-4c0b-8154-bcb5ec0d127d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:42.297115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:42.297791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:42.298082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:42.298361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:42.304772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:42.314352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:42.319656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:42.336191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1112/2249] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:42.400088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:42.411673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756e90-9590-4819-93a0-17f1418958f9 service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:42.417477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:42.418204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:42.418559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:42.418904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:42.420800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:42.433139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:42.434831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:42.446265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1138/2250] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:46.295823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:46.306955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5e921-cc15-4935-bf31-58f0dcab8423 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:46.312478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:46.313118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:46.313404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:46.313685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:46.315458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:46.372749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:46.374255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db6e5c-0b7a-4871-a93d-7529e20e0b82 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:46.383997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1113/2251] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:47.581054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:50:47.592807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd4a6-1f91-4097-97fd-031decabfa27 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:50:47.599324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:50:47.599972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:50:47.600257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:50:47.600535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:50:47.602333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:50:47.614548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:50:47.616165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:50:47.627022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1139/2252] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:50:56.379276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=34 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:57.622726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=12 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:01.899428 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:01.900752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:01.901228 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:01.920246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:01.921480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:01.928860 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1114/2253] 10.222.0.32 () {58 vars in 967 bytes} [Mon May 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:01.944072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:01.955972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8271d-4f6f-4535-913a-92f585ae3b1c service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:01.961861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:01.962612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:01.962958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:01.963416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:01.975332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:01.977010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:01.986035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1140/2254] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 15:51:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:51:09.604449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:09.617640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6094-aef5-4914-a47b-15177ac00e5d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:09.623594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:09.624251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:09.624551 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:09.625303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:09.627444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:09.686091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:09.687667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449d0d-83d9-45c5-aa90-114b5a22c0a3 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:09.697314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1115/2255] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:11.982179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:19.692603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=31 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:19.991049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:19.992631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:20.005365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db538-706a-4fbc-bce1-bde23728a909 service swift] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:20.009015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:20.009656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:20.009975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:20.010256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:20.020204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:20.021667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:20.031068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1141/2256] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:51:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:30.026874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:38.415331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:38.415919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:38.415919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:38.434638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] MFA Rules not processed for user `606ff49786a04aa5b677cbb9a57b216c`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:38.435988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:38.443079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1116/2257] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:48.428932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:07.041460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:52:07.042863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:52:07.100741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aac14-ff5f-4d47-b862-c11c5ac59910 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:52:07.104484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:52:07.105127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:52:07.105406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:52:07.105677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:52:07.107550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:52:07.119318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:52:07.120969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:52:07.130119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1142/2258] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:52:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:52:17.125754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=26 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:41.210892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:52:41.223979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e65b15-1ea3-41cd-8926-bca68519d067 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:52:41.229404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:52:41.230062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:52:41.230346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:52:41.230624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:52:41.232527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:52:41.302097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:52:41.303734 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:52:41.316052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1117/2259] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:52:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:52:51.309174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=28 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:59.806592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:52:59.820114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fcb89-cf32-4236-bdab-8521542388dd service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:52:59.826022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:52:59.826721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:52:59.827027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:52:59.827350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:52:59.829226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:52:59.896807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:52:59.898786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:52:59.908449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1143/2260] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:52:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:09.904673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=28 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:59.418104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:59.419571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:59.434574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a85f-e81a-407a-88ce-b6319acdb13f service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:59.442558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:59.443260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:59.443553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:59.445667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:59.445667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:59.459932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:59.461555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:59.472495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1118/2261] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:53:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:54:09.467550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:55.101385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:54:55.110825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0ab7-8d88-4799-ada6-674ab695b84c service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:54:55.115359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:54:55.116033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:54:55.116318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:54:55.116597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:54:55.127360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:54:55.128824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:54:55.140599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1144/2262] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:54:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:05.135626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:14.394442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:14.404091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e61da-8ee3-4e23-b0e5-382d8503e3b6 service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:14.407826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:14.408501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:14.408786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:14.409063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:14.417573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:14.419001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:14.429003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1119/2263] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:55:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:24.424060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:30.265512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.270707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:30.278194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75822-5b4e-41f2-81d6-d4503e8d3251 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.281795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.282428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.282709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.282988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.293280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.294754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.306702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1145/2264] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:40.301406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:02.028387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:02.036990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651426b-0d85-417b-bd27-417f60718827 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:02.040622 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:02.041479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:02.041611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:02.041814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:02.049268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:02.050774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:02.058692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1120/2265] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:56:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:12.055256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:55.351655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:55.355227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:55.372181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26853e-8084-4fb4-bbae-2663f463a4df service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:55.375946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:55.376684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:55.377034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:55.377378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:55.393474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:55.394978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:55.399179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b08096-9b69-4ce1-bf95-0c23163494ce service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:55.404831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:55.405464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:55.405749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:55.406031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:55.415998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:55.417738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:55.424323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1146/2266] 10.222.0.32 () {60 vars in 1396 bytes} [Mon May 23 15:56:55 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:55.444630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1121/2267] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:56:55.650435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:55.669935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299e363-82c8-43d1-b0a8-bb8dd11960f2 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:55.675452 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:55.676101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:55.676390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:55.676675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:55.684722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:55.686317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:55.714498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1147/2268] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:05.442270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=27 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:05.711690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=37 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:30.549765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:30.578517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaccbe-6df1-4504-8995-5ddb1709dd6a service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:30.582260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:30.582902 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:30.583227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:30.583510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:30.592769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:30.594036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:30.620829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1122/2269] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:57:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:40.618040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=20 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:55.590280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:55.600115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442deb2c-002a-4100-bbba-b4291bc137db service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:55.603650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:55.604288 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:55.604566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:55.604837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:55.613491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:55.614913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:55.641303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1148/2270] 10.222.0.32 () {60 vars in 1396 bytes} [Mon May 23 15:58:55 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:55.684314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:55.689393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:55.692482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931d82a-cb22-4bcd-9fe8-787093cc2ccb service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:55.696202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:55.696847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:55.697131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:55.697410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:55.705888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:55.707932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:55.710731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f153af6-df50-426e-bf01-366d293ea90a service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:55.716311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:55.717120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:55.717399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:55.717672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:55.727196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:55.728897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:55.735000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1123/2271] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:58:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:55.741317 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1149/2272] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:59:04.365442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:04.386291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e169d9-ae74-4ab4-b0f9-fec3acf4561d service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:04.391266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:04.391945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:04.392343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:04.392630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:04.402025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:04.403633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:04.413363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1124/2273] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:59:05.736504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=23 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:59:14.409275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=23 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:00:55.769971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:55.780046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fce5-c53f-4fb5-8b12-3c37884dc0c0 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:55.783619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:55.784251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:55.784536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:55.784818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:55.787297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:55.876798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:55.878231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:55.889306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1150/2274] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:55.939083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:55.940147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:55.940147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:55.945994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa8ecb-cc34-44a5-93fb-08d2fd62bd70 service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:55.949661 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:55.950307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:55.950593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:55.950897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:55.952881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:55.953750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec594d68-9344-4943-adc3-acc8ecc15d9a service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:55.959723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:55.960357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:55.960636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:55.960910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:55.962770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:55.967313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:55.968752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:55.986165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1125/2275] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:56.054169 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:56.055892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:56.076180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1151/2276] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:01:05.976265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:06.073476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=84 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:09.999603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:10.001286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:10.076591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7eca5-27d3-496d-9bfa-c6571cff5420 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:10.080176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:10.080819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:10.081100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:10.081375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:10.083287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:10.092935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:10.094350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:10.102642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1126/2277] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:20.098726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=35 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:56.188643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:56.188643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:56.196341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:56.196341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:56.210868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325ea5-c377-46d6-8073-17c050c86d2a service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:56.216745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:56.217390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:56.217675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:56.217956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:56.219894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:56.273055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295cd6-c7e4-49a9-9c9a-4599405e03f2 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:56.276927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:56.277814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:56.278180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:56.278544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:56.280773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:56.305171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:56.306763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:56.316512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1127/2278] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:02:56.359878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:56.361446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:56.371683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1152/2279] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:56.372812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:56.384119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1898aa-9e5b-40bb-99d4-7d003219a957 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:56.389991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:56.390642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:56.390931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:56.391257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:56.393645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:56.468089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:56.469678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:56.479479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1128/2280] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:02:56.664693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:56.677906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfb284-f238-4770-aecd-8155671b540c service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:56.683456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:56.684112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:56.684415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:56.684674 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:56.686579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:56.757796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:56.759521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:56.769487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1153/2281] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:01.007389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:01.020324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74785f8a-61eb-4988-9e4e-0a420149943d service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:01.027533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:01.028368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:01.028743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:01.029026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:01.031391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:01.046913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:01.048607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:01.064035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1129/2282] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:06.764626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:11.056055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=72 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:55.655834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:55.667763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c28d92-9d0f-4342-bbfe-011c57e4d851 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:55.673459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:55.674098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:55.674421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:55.674701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:55.676679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:55.749662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:55.751157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:55.760318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1154/2283] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:03:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:56.245751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:56.257515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b09138-6427-4280-9c1e-6af793aadd89 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:56.263997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:56.264628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:56.264911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:56.265188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:56.267065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:56.338455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:56.340102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:56.349358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1130/2284] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:03:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:04:05.756114 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=33 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:06.345026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=33 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:12.360190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:12.361269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:12.440669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ab8a-361c-45be-833b-1524da80ab30 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:12.445580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:12.446252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:12.446503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:12.446777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:12.449168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:12.460275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:12.461843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:12.472151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1155/2285] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:04:22.468136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=37 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:57.056658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.065840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1900db-8401-468f-bd1d-882d45b742e0 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.069667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.070298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.070579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.070851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.081295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.082705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.093312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1131/2286] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:05:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:58.193984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.203261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320c74-4eba-4c4a-9ca5-6333dbe414b5 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.206830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.207500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.207787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.208065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.218053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.219546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.230724 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1156/2287] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:07.088586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:08.225958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:15.008988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:15.010741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:15.023541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba71c3-181a-41ae-8e31-a26ae013efb9 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:15.027256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:15.027991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:15.028281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:15.028562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:15.037249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:15.038684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:15.047040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1132/2288] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:06:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:25.043220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:01.726038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:01.746078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f8f3-47d5-4e34-abb2-085ac310ee9d service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:01.749749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:01.750389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:01.750669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:01.751255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:01.776524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:01.777953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:01.787518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1157/2289] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:07:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:11.783308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=17 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:56.541660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:56.577847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30966082-6117-46ca-a5d8-e2ae5def8da1 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:56.583185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:56.583828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:56.584110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:56.584386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:56.592658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:56.594220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:56.620705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1133/2290] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:07:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:08:06.618246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=24 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:08:56.115228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:56.146915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dfbba-f904-4e27-a9c7-f0fc54fec207 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:56.152602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:56.153263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:56.153548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:56.153826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:56.165382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:56.166973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:56.199388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1158/2291] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:08:56.756520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:56.777985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994cf95-1f5b-4ebb-b78d-160cd9b5d88d service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:56.783348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:56.783998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:56.784283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:56.784566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:56.792242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:56.793805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:56.823483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1134/2292] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:00.623351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:00.632946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aca331-1a0b-41bc-82ab-f7fbe80a89a4 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:00.636549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:00.637192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:00.637476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:00.637754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:00.639556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:00.728207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:00.729577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:00.749184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1159/2293] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:02.024223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:02.046912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bdbae-0875-40b9-b195-ec7ce17c415f service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:02.051313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:02.051982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:02.052269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:02.052548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:02.065321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:02.066793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:02.102485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1135/2294] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:02.155785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:02.165161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0db4e7-362d-4ad7-8731-4d2a22a2f532 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:02.170200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:02.170200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:02.170881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:02.171209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:02.180798 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:02.182240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:02.210564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1160/2295] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:02.259844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:02.269034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b7e71-9248-4676-9068-ef5bce35d0e1 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:02.272889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:02.273538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:02.273829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:02.274113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:02.283422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:02.284867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:02.313473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1136/2296] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:04.752916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:04.755043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:04.784880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9101f-0cd0-4de8-af7a-d5e4d669f87f service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:04.791391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:04.792302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:04.792752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:04.793042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:04.795875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:04.810170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:04.811852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:04.822901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1161/2297] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:05.290076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:05.305565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a213-5818-4d3d-8983-9f1545820dca service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:05.313782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:05.314808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:05.315392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:05.315743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:05.325837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:05.327636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:05.340205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1137/2298] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:09.018684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:09.020197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:09.033916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3798cc-1d8e-43a7-9a13-eb211fe708f1 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:09.038556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:09.039570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:09.039978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:09.040262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] PATH_INFO: `/v3/users/e6ed5088d3494139b93a7d2af4b48a12` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:09.041470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ed5088d3494139b93a7d2af4b48a12)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:09.043428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:09.126494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:09.233090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ed5088d3494139b93a7d2af4b48a12'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.233813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ed5088d3494139b93a7d2af4b48a12'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.234557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ed5088d3494139b93a7d2af4b48a12'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.248549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ed5088d3494139b93a7d2af4b48a12'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.255289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ed5088d3494139b93a7d2af4b48a12'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.342636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1162/2299] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:09:09 2022] DELETE /identity/v3/users/e6ed5088d3494139b93a7d2af4b48a12 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:09.583061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:09.598193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7b88-d00e-4603-b8f0-74c984171e2a service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:09.660382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:09.661260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:09.661548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:09.661838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] PATH_INFO: `/v3/projects/652580a82e9c4f3b84eda950e5613a48` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:09.663030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652580a82e9c4f3b84eda950e5613a48)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:09.665036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:09.791398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:09.794103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652580a82e9c4f3b84eda950e5613a48', 'request_id': 'req-456af654-fd40-491b-a0b0-76f9406e1f20'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.799543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652580a82e9c4f3b84eda950e5613a48', 'request_id': 'req-456af654-fd40-491b-a0b0-76f9406e1f20'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.805790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652580a82e9c4f3b84eda950e5613a48', 'request_id': 'req-456af654-fd40-491b-a0b0-76f9406e1f20'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.886045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] The token cache is being invalidate because project 652580a82e9c4f3b84eda950e5613a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:09:09.886366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.886992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:09.888577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1138/2300] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:09:09 2022] DELETE /identity/v3/projects/652580a82e9c4f3b84eda950e5613a48 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:09.893265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:09.894678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:09.908104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a74cc-6360-4cf8-b603-ff0e1c742a67 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:09.963225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:09.964099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:09.964384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:09.964662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] PATH_INFO: `/v3/users/28c6ca7ad6bf49cea4b2cb8db42e4f6d` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:09.978034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c6ca7ad6bf49cea4b2cb8db42e4f6d)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:09.980028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:10.128036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c6ca7ad6bf49cea4b2cb8db42e4f6d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.129135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c6ca7ad6bf49cea4b2cb8db42e4f6d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.129671 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c6ca7ad6bf49cea4b2cb8db42e4f6d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.145075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c6ca7ad6bf49cea4b2cb8db42e4f6d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.152119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f59a4615-e9cf-44a8-9524-ee00b6117494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c6ca7ad6bf49cea4b2cb8db42e4f6d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.227705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1163/2301] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:09:09 2022] DELETE /identity/v3/users/28c6ca7ad6bf49cea4b2cb8db42e4f6d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:10.518248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:10.519803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:10.534337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af654-fd40-491b-a0b0-76f9406e1f20 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:10.593318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:10.594732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:10.595014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:10.595317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] PATH_INFO: `/v3/projects/7f2692c1c5dc42ffb287cd92d7041b47` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:10.607339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2692c1c5dc42ffb287cd92d7041b47)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:10.611047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:10.725088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2692c1c5dc42ffb287cd92d7041b47', 'request_id': 'req-7226140d-aa57-4fda-822b-1cdb56e19f5d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.733853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2692c1c5dc42ffb287cd92d7041b47', 'request_id': 'req-7226140d-aa57-4fda-822b-1cdb56e19f5d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.742793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2692c1c5dc42ffb287cd92d7041b47', 'request_id': 'req-7226140d-aa57-4fda-822b-1cdb56e19f5d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.826787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] The token cache is being invalidate because project 7f2692c1c5dc42ffb287cd92d7041b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:09:10.827076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.827903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7226140d-aa57-4fda-822b-1cdb56e19f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:09:10.830063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1139/2302] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:09:10 2022] DELETE /identity/v3/projects/7f2692c1c5dc42ffb287cd92d7041b47 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:10.835159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:10.835459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:10.835797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:10.851382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:10.894738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:09:10.895973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:10.973549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1164/2303] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:09:10.981652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:10.981955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:10.982242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.000644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:09:11.001836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:11.009851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1140/2304] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:09:11.014177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.024604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e73366-6d32-454c-a5c5-513ac7ad26ff None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.029203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.029855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.030139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.030418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.031186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:09:11.032095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.033705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.045050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1165/2305] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:09:11.049225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.058392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c12137-e99b-4761-88cc-c99f6b6002e7 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.063343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.064016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.064303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.064586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.065292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.067231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.194070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1141/2306] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:09:11 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:09:11.198151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.208938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a33a-dfcd-44f9-9da0-2560cb7c9d96 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.264935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.266354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.266639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.266914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.267647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.269571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.383936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1166/2307] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:09:11 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:09:11.388394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.400002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1cbb2-4199-4924-9961-7e870809bb7e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.404531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.405306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.405591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.406181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.407642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.409320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.419695 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1142/2308] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:09:11.423648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.433532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eb7ae-1846-4543-848e-25ec85926fb8 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.438811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58324c75-d4a4-4b75-8dc2-22452c3b0c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.439540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58324c75-d4a4-4b75-8dc2-22452c3b0c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.439829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58324c75-d4a4-4b75-8dc2-22452c3b0c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.440112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58324c75-d4a4-4b75-8dc2-22452c3b0c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.440853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58324c75-d4a4-4b75-8dc2-22452c3b0c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.442476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58324c75-d4a4-4b75-8dc2-22452c3b0c5d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.452593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1167/2309] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:09:11.457279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.467170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a588a-676e-4ef9-ae7f-2ef8669e84c0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.471827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.472707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.472991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.473270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] PATH_INFO: `/v3/projects/01d73e969cd644d5a39fef629584bd12/users/789bc635e0dc4adea61f3adf29916258/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.475502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:11.489422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d73e969cd644d5a39fef629584bd12, user_id=789bc635e0dc4adea61f3adf29916258, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.492206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.567682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1143/2310] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:09:11 2022] PUT /identity/v3/projects/01d73e969cd644d5a39fef629584bd12/users/789bc635e0dc4adea61f3adf29916258/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:11.572845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.573144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.573427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.592257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:09:11.593507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:11.648386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:11.664924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1168/2311] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:09:11.674799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:11.676701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:11.735562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47647245-748c-4b55-9ed3-3f6517b18753 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:11.739772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede34ee-94c9-45f2-98bd-d3872b3ea7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:11.740400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede34ee-94c9-45f2-98bd-d3872b3ea7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:11.740624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede34ee-94c9-45f2-98bd-d3872b3ea7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:11.740904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede34ee-94c9-45f2-98bd-d3872b3ea7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:11.757632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede34ee-94c9-45f2-98bd-d3872b3ea7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:11.759329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede34ee-94c9-45f2-98bd-d3872b3ea7c7 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:11.771354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1144/2312] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:09:16.341762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:16.343437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:16.424249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609aa4-f599-489e-9549-941ebe3e492f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:16.430286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:16.430949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:16.431271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:16.431928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:16.433866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:16.448318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:16.450016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:16.460906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1169/2313] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:17.808287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:17.808287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:17.808764 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:17.834997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] MFA Rules not processed for user `789bc635e0dc4adea61f3adf29916258`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:09:17.836313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:17.900092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1145/2314] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:09:17.904582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:17.915667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a5a4-12d3-47a9-800d-5c208b33ffc0 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:17.920538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:17.921233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:17.921515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:17.922364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:17.923072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:17.925040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:18.008953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1170/2315] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:09:17 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:09:18.012883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:18.024733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6a97-87f9-4fe8-9d5f-93677b0f4071 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:18.094091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:18.094947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:18.095334 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:18.095756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:18.096550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:18.098630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:18.219718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1146/2316] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:09:18 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:09:18.223566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:18.239417 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4987390-4bae-44e0-9657-d662222f0975 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:18.250793 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:18.251743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:18.252209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:18.252638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:18.253578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:18.255869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:18.270495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1171/2317] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:09:18.282296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:18.292605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:18.297478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0ff02-cba3-4ac0-8521-45315aabc9f9 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:18.303039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:18.304296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:18.304804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:18.305288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] PATH_INFO: `/v3/projects/a20412a5437a45dfa26dbdf851397c58/users/2a3a2a6a1a7f40b8bbbd12d37a7ca3ab/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:18.322913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20412a5437a45dfa26dbdf851397c58, user_id=2a3a2a6a1a7f40b8bbbd12d37a7ca3ab, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:18.327022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:18.399660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1147/2318] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:09:18 2022] PUT /identity/v3/projects/a20412a5437a45dfa26dbdf851397c58/users/2a3a2a6a1a7f40b8bbbd12d37a7ca3ab/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:18.402425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:18.422167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaa2fc-e6b6-4e46-9b0b-0bafcc026ce6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:18.492858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598641a0-b5d8-46b9-b547-a450be27c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:18.493711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598641a0-b5d8-46b9-b547-a450be27c8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:18.494009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598641a0-b5d8-46b9-b547-a450be27c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:18.494274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598641a0-b5d8-46b9-b547-a450be27c8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:18.495022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598641a0-b5d8-46b9-b547-a450be27c8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:18.496823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598641a0-b5d8-46b9-b547-a450be27c8f5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:18.512895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1172/2319] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:09:18.514140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:18.526369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f6bae-6998-4564-9856-d2e5a6663ed1 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:18.532119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:18.533201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:18.533603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:18.534075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] PATH_INFO: `/v3/projects/a20412a5437a45dfa26dbdf851397c58/users/2a3a2a6a1a7f40b8bbbd12d37a7ca3ab/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:18.536173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20412a5437a45dfa26dbdf851397c58, user_id=2a3a2a6a1a7f40b8bbbd12d37a7ca3ab, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:18.538981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:18.556379 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1148/2320] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:09:18 2022] PUT /identity/v3/projects/a20412a5437a45dfa26dbdf851397c58/users/2a3a2a6a1a7f40b8bbbd12d37a7ca3ab/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:09:25.531443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d7f6-edfd-4e83-aaec-f1666454f722 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:25.531977 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d7f6-edfd-4e83-aaec-f1666454f722 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:25.532096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d7f6-edfd-4e83-aaec-f1666454f722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:25.560795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5d25d7f6-edfd-4e83-aaec-f1666454f722 None None] MFA Rules not processed for user `2a3a2a6a1a7f40b8bbbd12d37a7ca3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:09:25.562035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5d25d7f6-edfd-4e83-aaec-f1666454f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:25.594936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:25.637109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1173/2321] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:09:25.650417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:25.652273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:25.728862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f2c6-6aca-4314-be41-cec285097f11 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:25.736907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa652d-90a8-45de-a9bc-482474a830c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:25.737625 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa652d-90a8-45de-a9bc-482474a830c2 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:25.737854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa652d-90a8-45de-a9bc-482474a830c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:25.738132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa652d-90a8-45de-a9bc-482474a830c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:25.795252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa652d-90a8-45de-a9bc-482474a830c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:25.797395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa652d-90a8-45de-a9bc-482474a830c2 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:25.806248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1149/2322] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:09:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:35.736256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=16 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:35.802195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:10:33.511623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b94e3-4be1-4d39-b93e-a33bee36bb37 None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:33.512244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b94e3-4be1-4d39-b93e-a33bee36bb37 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:33.512406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b94e3-4be1-4d39-b93e-a33bee36bb37 None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:33.513851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1174/2323] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 16:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:10:33.528083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462427bb-e120-4510-9203-c676a3746548 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:33.528566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462427bb-e120-4510-9203-c676a3746548 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:33.528825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462427bb-e120-4510-9203-c676a3746548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:33.577634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-462427bb-e120-4510-9203-c676a3746548 None None] MFA Rules not processed for user `99e4d094e08a4f1d92aed40961789f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:10:33.579045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-462427bb-e120-4510-9203-c676a3746548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:33.646076 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1150/2324] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:10:33.665979 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b94e3-4be1-4d39-b93e-a33bee36bb37 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:33.681731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b94e3-4be1-4d39-b93e-a33bee36bb37 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:33.688484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:33.689236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:33.689587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:33.689932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:33.706706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:33.708480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:33.720980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1175/2325] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:10:37.208092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462427bb-e120-4510-9203-c676a3746548 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:37.283257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462427bb-e120-4510-9203-c676a3746548 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:37.288127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:37.289041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:37.289331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:37.289611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] PATH_INFO: `/v3/users/789bc635e0dc4adea61f3adf29916258` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:37.290817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789bc635e0dc4adea61f3adf29916258)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:37.293362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:37.514165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789bc635e0dc4adea61f3adf29916258'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:37.576292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789bc635e0dc4adea61f3adf29916258'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:37.576909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789bc635e0dc4adea61f3adf29916258'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:37.590892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789bc635e0dc4adea61f3adf29916258'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:37.596401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:10:37.599679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789bc635e0dc4adea61f3adf29916258'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:37.606080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1151/2326] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:10:37 2022] DELETE /identity/v3/users/789bc635e0dc4adea61f3adf29916258 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:10:37.880297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:37.892111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ae6b7-5a90-45e0-a455-6cb50bb2f1bb service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:37.954716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:37.955526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:37.955809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:37.956086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] PATH_INFO: `/v3/projects/01d73e969cd644d5a39fef629584bd12` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:37.957260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d73e969cd644d5a39fef629584bd12)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:37.959282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:38.095301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d73e969cd644d5a39fef629584bd12', 'request_id': 'req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.181799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d73e969cd644d5a39fef629584bd12', 'request_id': 'req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.189654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d73e969cd644d5a39fef629584bd12', 'request_id': 'req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.200633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] The token cache is being invalidate because project 01d73e969cd644d5a39fef629584bd12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:10:38.200924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.201566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.203336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1176/2327] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:10:37 2022] DELETE /identity/v3/projects/01d73e969cd644d5a39fef629584bd12 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:10:38.207810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:38.209219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:38.226599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce499f-038d-47e0-851c-074c923bf500 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:38.288103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:38.288981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:38.289265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:38.289541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] PATH_INFO: `/v3/users/2a3a2a6a1a7f40b8bbbd12d37a7ca3ab` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:38.290726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3a2a6a1a7f40b8bbbd12d37a7ca3ab)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:38.293216 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:38.502567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3a2a6a1a7f40b8bbbd12d37a7ca3ab'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.570647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3a2a6a1a7f40b8bbbd12d37a7ca3ab'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.571330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3a2a6a1a7f40b8bbbd12d37a7ca3ab'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.584534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3a2a6a1a7f40b8bbbd12d37a7ca3ab'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.596676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3a2a6a1a7f40b8bbbd12d37a7ca3ab'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:38.609791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1152/2328] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:10:38 2022] DELETE /identity/v3/users/2a3a2a6a1a7f40b8bbbd12d37a7ca3ab => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:10:38.874883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:38.876395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:38.894988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe6d0f-fcd6-4395-ab36-574d0d4c1b14 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:38.953593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:38.954447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:38.954728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:38.955001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] PATH_INFO: `/v3/projects/a20412a5437a45dfa26dbdf851397c58` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:38.956200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20412a5437a45dfa26dbdf851397c58)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:38.958112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:38.978527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:10:39.102973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20412a5437a45dfa26dbdf851397c58', 'request_id': 'req-e564b095-3ae6-467f-90ea-04a6d77548be'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:39.176001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20412a5437a45dfa26dbdf851397c58', 'request_id': 'req-e564b095-3ae6-467f-90ea-04a6d77548be'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:39.182813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20412a5437a45dfa26dbdf851397c58', 'request_id': 'req-e564b095-3ae6-467f-90ea-04a6d77548be'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:39.193129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] The token cache is being invalidate because project a20412a5437a45dfa26dbdf851397c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:10:39.193623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:39.194071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:10:39.195784 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1177/2329] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:10:38 2022] DELETE /identity/v3/projects/a20412a5437a45dfa26dbdf851397c58 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:10:48.599683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:10:49.190100 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:10:58.173287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:58.174786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:58.246438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e215a9-2e1a-47a9-8df4-46cc3c79543d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:58.303986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:58.304648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:58.304934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:58.305212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:58.307052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:58.326658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:10:58.328075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:58.340668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b095-3ae6-467f-90ea-04a6d77548be admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:10:58.344237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:10:58.344906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:10:58.345190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:10:58.345492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:10:58.347318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:10:58.390286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:58.392262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:58.404045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1153/2330] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:10:58.421064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:10:58.422516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:10:58.433753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1178/2331] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:11:08.398634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=83 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:11:08.428741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=34 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:11:20.867462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:11:20.868865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:11:20.902865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4642-9582-4b97-a942-2d81bbaaf2c9 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:11:20.906476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:11:20.907759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:11:20.908047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:11:20.908326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:11:20.910095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:11:20.919377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:11:20.920788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:11:20.929065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1154/2332] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:11:30.925145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=15 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:12:01.968573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:12:01.970595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:12:01.984115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a086be2-60f6-4307-b982-77d07a6fef71 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:12:01.989595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:12:01.990285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:12:01.990578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:12:01.990858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:12:01.992707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:12:02.096373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:12:02.097984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:12:02.116224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1179/2333] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:12:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:12:12.113484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=41 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:13:32.697093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:13:32.698583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:13:32.766289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a233e3-e81a-4966-b00e-57d85331915e service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:13:32.770287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:13:32.771460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:13:32.771749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:13:32.772028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:13:32.773843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:13:32.851531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:13:32.852981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:13:32.862647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1155/2334] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:13:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:13:42.858025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=58 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:14:01.221744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:14:01.237318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf619d-e90c-460c-aa47-3b5aa979729b service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:14:01.239866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:14:01.240554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:14:01.240836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:14:01.241116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:14:01.242968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:14:01.317735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:14:01.319445 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:14:01.328519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1180/2335] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:14:01.371369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:14:01.372854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:14:01.388504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f236b98-dffd-427b-8bcb-8e5b8622905d service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:14:01.393922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:14:01.394843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:14:01.395150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:14:01.395431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:14:01.397173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:14:01.467921 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:14:01.469473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:14:01.478986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1156/2336] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:14:01.497015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:14:01.508194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dea1e-5ac7-4344-9269-bf46423073c6 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:14:01.517529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:14:01.518195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:14:01.518485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:14:01.518764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:14:01.520911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:14:01.595461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:14:01.597097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916375e-afe4-497b-9292-8dfa87f18c53 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:14:01.606255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1181/2337] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:14:11.474291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=33 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:14:11.601859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=66 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:14:22.347757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:14:22.349673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:14:22.432910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe2821-abf6-4a1a-a5f0-16cf654bd26d service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:14:22.437823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:14:22.438470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:14:22.438754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:14:22.439079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:14:22.440942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:14:22.452981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:14:22.454750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:14:22.465168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1157/2338] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:14:32.460390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=37 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:15:03.376447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:03.376882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:03.377036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:03.426080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:15:03.427454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:03.520286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1182/2339] 10.222.0.32 () {58 vars in 967 bytes} [Mon May 23 16:15:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:15:03.736950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:03.738705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:03.856377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb15629-0de0-4946-bd75-b4886ff106c8 service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:03.861545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530e432-667c-4340-8344-fb97b0a3801e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:03.862204 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e432-667c-4340-8344-fb97b0a3801e service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:03.862522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e432-667c-4340-8344-fb97b0a3801e service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:03.862804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e432-667c-4340-8344-fb97b0a3801e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:03.872540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530e432-667c-4340-8344-fb97b0a3801e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:03.874171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530e432-667c-4340-8344-fb97b0a3801e service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:03.887288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1158/2340] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 16:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:15:05.173856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:05.183391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf04d7b-b478-41c3-8613-77b1256bfc75 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:05.187023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:05.187702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:05.188095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:05.188376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:05.190196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:05.255241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:05.256682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3c1db-8519-4fef-b8c9-f2385f5bbfe3 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:05.266713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1183/2341] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:07.951585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:07.952708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:07.952918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:07.985095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] MFA Rules not processed for user `72deeff329a6482cbfdb828a1996b127`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:15:07.987356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:08.002447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1159/2342] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:15:08.268220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:08.268766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:08.279717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:08.307609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] MFA Rules not processed for user `6d689e7ca175463ab0c319260ba49d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:15:08.309974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:08.320576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1184/2343] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:15:08.557308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:08.568642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb87e3-4d6e-4297-a429-c876daa1f0ed None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:08.572372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:08.573052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:08.573333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:08.573609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:08.576148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:08.587548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:08.589635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:08.598433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1160/2344] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:08.857982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:08.869567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49bb7a-124d-4a6c-b3dd-d534b68e3491 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:08.873756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:08.874397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:08.874678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:08.874954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:08.876802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:08.886659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:08.888165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:08.897357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1185/2345] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:09.122648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:09.124672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:09.140123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5206ed-bfd3-4ab8-9954-8414702bfe29 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:09.145707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:09.146420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:09.146709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:09.147015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:09.148889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:09.162380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:09.164169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:09.179469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1161/2346] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:12.906227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:12.926675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc560d95-db3f-4f3d-9cc5-ff4cc10b2e32 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:12.932280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:12.932935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:12.933215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:12.933487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:12.935926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:12.948775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:12.950948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:12.962335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1186/2347] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:19.175068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=59 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:15:20.712171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:20.724955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3ae8-011f-477f-b243-cbd2c5cca5db service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:20.730373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:20.731019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:20.731853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:20.732149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:20.733945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:20.748279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:20.749897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:20.762447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1162/2348] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:22.957584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:15:26.844542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:26.857105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bdda-e117-4af7-8827-edcabd988f0c service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:26.863722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:26.864467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:26.864752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:26.865035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:26.866902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:26.880252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:26.881868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:26.894523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1187/2349] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:30.758362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:15:33.023794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:33.034525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb4b09-4846-40d4-b264-45230ad14f0c service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:33.038080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:33.038724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:33.039012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:33.039358 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:33.041224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] Could not find project: 652580a82e9c4f3b84eda950e5613a48.: keystone.exception.ProjectNotFound: Could not find project: 652580a82e9c4f3b84eda950e5613a48. May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 23 16:15:33.075467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:15:33.079955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._validate_token_resources() May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:15:33.081402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:15:33.082769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:15:33.084157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 652580a82e9c4f3b84eda950e5613a48. May 23 16:15:33.084157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 16:15:33.084157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1163/2350] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:33 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 23 16:15:33.100821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:33.110686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632558-5473-4c9b-a52e-ceb206f2afa6 service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:33.114458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:33.115119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:33.118907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:33.118907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:33.118907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:15:33.190796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:33.192266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:33.201657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1188/2351] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:43.044756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:15:43.196968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=39 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:15:59.535885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:59.542440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:15:59.545484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce86c6-d6bb-49c0-bdd5-3ebf48925ec6 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:59.549600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:59.550238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:59.550522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:59.550801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:59.551526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e923-744b-4d19-807a-c57210eae61f service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:15:59.555139 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:15:59.555769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:15:59.556050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:15:59.556331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:15:59.562082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:59.564042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:59.567396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:15:59.568815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:15:59.575047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1164/2352] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:15:59.580140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1189/2353] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:15:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:16:09.570280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:16:09.574715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:17:25.778923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:17:25.787400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10ae07-2291-43b2-aea7-a319bba5f4ae service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:17:25.790942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:17:25.791737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:17:25.792019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:17:25.792293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:17:25.799819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:17:25.801794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:17:25.809875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1165/2354] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:17:35.806333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:18:33.479901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:18:33.528681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4067-3406-4065-85ec-8bf8844a33d5 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:18:33.534832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:18:33.535522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:18:33.535811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:18:33.536118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:18:33.544292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:18:33.545894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:18:33.572986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1190/2355] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:18:43.570153 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=30 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:19:03.939253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:19:03.940654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:19:03.981028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a5b75-5e64-4370-88d3-4ad4aa9630cf service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:19:03.985238 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:19:03.985872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:19:03.986160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:19:03.986442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:19:03.994685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:19:03.996208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:19:04.021817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1166/2356] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:19:04.075081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:19:04.084401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742a880-05b4-49d0-ad04-b2027ee0f0de service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:19:04.087888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:19:04.088520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:19:04.088799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:19:04.089073 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:19:04.097867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:19:04.099315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:19:04.125826 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1191/2357] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:19:14.019262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=26 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:19:14.123284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=13 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:19:26.335669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:19:26.356624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debe49-bfca-4e79-b0de-6367960a642a service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:19:26.362226 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:19:26.362859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:19:26.363179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:19:26.363457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:19:26.371824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:19:26.373609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:19:26.383158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1167/2358] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:19:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:19:34.850470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:19:34.858824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51935-2a19-4f0d-90a4-04dde2afea87 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:19:34.863277 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:19:34.863913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:19:34.864198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:19:34.864477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:19:34.872717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:19:34.874147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:19:34.901248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1192/2359] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:19:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:19:36.379162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:19:44.898468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=13 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:20:33.428629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:20:33.451198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19647a-26a6-432e-81e2-9ad124f2d63b service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:20:33.456552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:20:33.457242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:20:33.457523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:20:33.457824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:20:33.466281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:20:33.467893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:20:33.494867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1168/2360] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:20:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:20:43.492033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=17 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:21:00.681521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:00.683283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:21:00.703291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:00.704933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:21:00.750035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f155e28-4c69-48e9-8d59-97078555439f service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:00.754264 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:00.754919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:00.755252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:00.755521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:00.757391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:21:00.762577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baa0fe-0338-4207-921e-74fe5bc2eee1 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:00.766943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:00.767645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:00.767926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:00.768200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:00.770023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:21:00.840928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:00.842387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:00.853537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:00.856372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1193/2361] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:21:00.856547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:00.866479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1169/2362] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:21:10.849076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=63 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:21:10.861439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=59 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:21:35.334361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:35.346721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50355-2bbc-4da7-bea6-8ce1f19be295 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:35.354244 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633e08b-bc8e-40fa-a30e-9eeadd96b2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:35.355227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e08b-bc8e-40fa-a30e-9eeadd96b2a5 service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:35.355707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e08b-bc8e-40fa-a30e-9eeadd96b2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:35.356163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e08b-bc8e-40fa-a30e-9eeadd96b2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:35.367145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633e08b-bc8e-40fa-a30e-9eeadd96b2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:35.368929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633e08b-bc8e-40fa-a30e-9eeadd96b2a5 service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:35.381620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1194/2363] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:21:35.546500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:35.561836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba86d26-46b9-4e58-8fbb-c8be64155e61 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:35.577999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:35.579709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:35.581560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:35.584541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:35.609594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:35.611567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:35.635183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1170/2364] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:21:37.935330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:37.935841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:37.935969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:37.963182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] MFA Rules not processed for user `8b0a82159c6343d28546ec7c775b8791`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:21:37.964306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:21:37.971267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1195/2365] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:21:38.277142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:38.296810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70200-ae02-466a-bdc4-82be17579660 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:38.300517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:38.301155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:38.301439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:38.301715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:38.308957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:38.310378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:38.318319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1171/2366] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:21:38.667994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:38.680004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5364d-99cb-4f33-93b6-870f39d7dd1c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:38.685075 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:38.685788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:38.686081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:38.686365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:38.695973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:38.697574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:38.707633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1196/2367] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:21:48.314776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=16 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:21:48.703304 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=18 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:21:50.686111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:21:50.704856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a66f22-83dc-43ff-86f9-5496f20455cb service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:21:50.710342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:21:50.710983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:21:50.711298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:21:50.711581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:21:50.723932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:21:50.726511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:21:50.737177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1172/2368] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:22:00.732669 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:22:28.973125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:22:28.984094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38083dce-f331-4b41-9818-f4abf352b609 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:22:28.987631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:22:28.988271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:28.988556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:28.988835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:28.990691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:29.014084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:22:29.015545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:22:29.023368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1197/2369] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:22:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:22:29.335202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:22:29.336632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:29.444037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bba43-de4c-4ec6-b7ea-15ddc9860d62 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:22:29.448392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:22:29.449325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:29.449797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:29.450257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:29.452570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] Could not find project: 01d73e969cd644d5a39fef629584bd12.: keystone.exception.ProjectNotFound: Could not find project: 01d73e969cd644d5a39fef629584bd12. May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 23 16:22:29.468426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:22:29.471041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self._validate_token_resources() May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 16:22:29.472468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.get_or_create( May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application with Lock( May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._enter() May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.creator() May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application created_value = creator( May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 16:22:29.474027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 16:22:29.475526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 01d73e969cd644d5a39fef629584bd12. May 23 16:22:29.475526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: ERROR keystone.server.flask.application May 23 16:22:29.478105 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1173/2370] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:22:29 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 23 16:22:32.419871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:22:32.428457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69cfc-a52a-4892-b06f-05408f69f306 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:22:32.432133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:22:32.432776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:32.433063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:32.433349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:32.435160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:32.469811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:22:32.471392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e79313-19f3-454a-927b-0c89380abecf service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:22:32.491237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1198/2371] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:22:33.797916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:22:33.808589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a245f-e575-4ec8-859f-705057ed3dbc service glance] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:22:33.812141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:22:33.812782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:33.813068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:33.813342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:33.815495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:33.920053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:22:33.921545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:22:33.940488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1174/2372] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:22:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:22:42.488717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=30 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:22:43.937621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=74 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:22:51.440458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859d3e-35c7-45f8-853b-4442507a0841 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:51.441245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859d3e-35c7-45f8-853b-4442507a0841 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:51.441245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859d3e-35c7-45f8-853b-4442507a0841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:51.458846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-03859d3e-35c7-45f8-853b-4442507a0841 None None] MFA Rules not processed for user `72deeff329a6482cbfdb828a1996b127`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:22:51.460081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-03859d3e-35c7-45f8-853b-4442507a0841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:51.467631 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1199/2373] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:22:51.836026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:22:51.845877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8e320-05b2-4bbc-a948-6ff830447140 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:22:51.849442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:22:51.850080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:51.850368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:51.850654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:51.857741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:22:51.859198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:22:51.866959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1175/2374] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:22:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:22:55.706318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6904-fdc2-451f-9748-d34f0f75655d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:55.706833 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6904-fdc2-451f-9748-d34f0f75655d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:55.707015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6904-fdc2-451f-9748-d34f0f75655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:55.735938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-2e6c6904-fdc2-451f-9748-d34f0f75655d None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:22:55.737172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2e6c6904-fdc2-451f-9748-d34f0f75655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:22:55.744637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1200/2375] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 16:22:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:22:55.935704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:22:55.950221 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b021-f27f-4485-9937-5ab38bed89f2 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:22:55.955542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356107c-7e11-488a-8760-0904ccd35ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:22:55.956206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356107c-7e11-488a-8760-0904ccd35ea8 service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:22:55.956707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356107c-7e11-488a-8760-0904ccd35ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:22:55.956988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356107c-7e11-488a-8760-0904ccd35ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:22:55.968006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356107c-7e11-488a-8760-0904ccd35ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:22:55.969666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356107c-7e11-488a-8760-0904ccd35ea8 service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:22:55.980481 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1176/2376] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 16:22:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:23:05.730665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:23:05.976072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=12 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:23:13.666834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93d4f1-730b-472a-a230-6ce404e622ad None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:13.667437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93d4f1-730b-472a-a230-6ce404e622ad None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:13.667437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93d4f1-730b-472a-a230-6ce404e622ad None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:13.669350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1201/2377] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 16:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:23:13.676407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d8de-2b8e-4dbf-8e55-661b9f5a48e7 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:13.676893 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d8de-2b8e-4dbf-8e55-661b9f5a48e7 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:13.677162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d8de-2b8e-4dbf-8e55-661b9f5a48e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:13.728750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a1d1d8de-2b8e-4dbf-8e55-661b9f5a48e7 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:23:13.729961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a1d1d8de-2b8e-4dbf-8e55-661b9f5a48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:13.739595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1177/2378] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:23:13.751501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93d4f1-730b-472a-a230-6ce404e622ad None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:23:13.753141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cd93d4f1-730b-472a-a230-6ce404e622ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:13.766097 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93d4f1-730b-472a-a230-6ce404e622ad None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:23:13.769660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a87534-49f5-4761-9c74-1df3a3a6f8ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:23:13.770291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87534-49f5-4761-9c74-1df3a3a6f8ee service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:13.770573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87534-49f5-4761-9c74-1df3a3a6f8ee service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:13.770853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87534-49f5-4761-9c74-1df3a3a6f8ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:13.780858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a87534-49f5-4761-9c74-1df3a3a6f8ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:23:13.785560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a87534-49f5-4761-9c74-1df3a3a6f8ee service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:23:13.793581 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1202/2379] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:23:14.002839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b0a4-533b-4255-bf66-ab2a56a75853 None None] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:14.003244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b0a4-533b-4255-bf66-ab2a56a75853 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:14.003541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b0a4-533b-4255-bf66-ab2a56a75853 None None] PATH_INFO: `/` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:14.004926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1178/2380] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 16:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:23:14.009733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1d31-5c6b-4f69-9801-7467250e15a0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:14.010027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1d31-5c6b-4f69-9801-7467250e15a0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:14.010310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1d31-5c6b-4f69-9801-7467250e15a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:14.047516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0f0a1d31-5c6b-4f69-9801-7467250e15a0 None None] MFA Rules not processed for user `2f5e9e3f2475457ba9b307438e5cf97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:23:14.048722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0f0a1d31-5c6b-4f69-9801-7467250e15a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:14.055183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1203/2381] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:23:14.066891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50b0a4-533b-4255-bf66-ab2a56a75853 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:23:14.068628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0e50b0a4-533b-4255-bf66-ab2a56a75853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:14.081347 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50b0a4-533b-4255-bf66-ab2a56a75853 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:23:14.084836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb871-2215-4fcd-952f-315075fd9148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:23:14.085460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb871-2215-4fcd-952f-315075fd9148 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:14.085742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb871-2215-4fcd-952f-315075fd9148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:14.086016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb871-2215-4fcd-952f-315075fd9148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:14.093372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbb871-2215-4fcd-952f-315075fd9148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:23:14.094772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbb871-2215-4fcd-952f-315075fd9148 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:23:14.102419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1179/2382] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:23:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:23:14.187612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9791b-25fb-43af-8ad9-eb0be0f92e8c None None] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:14.187902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9791b-25fb-43af-8ad9-eb0be0f92e8c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:14.188182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9791b-25fb-43af-8ad9-eb0be0f92e8c None None] PATH_INFO: `/` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:14.189670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1204/2383] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 23 16:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:23:14.199163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c474e2-c500-4a05-89cd-77ca06ac3e00 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:14.199460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c474e2-c500-4a05-89cd-77ca06ac3e00 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:14.199743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c474e2-c500-4a05-89cd-77ca06ac3e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:14.217666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f9c474e2-c500-4a05-89cd-77ca06ac3e00 None None] MFA Rules not processed for user `6867f7729ddf465ca6d31df087c00881`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:23:14.218840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f9c474e2-c500-4a05-89cd-77ca06ac3e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:14.227783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1180/2384] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 23 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:23:14.238957 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9791b-25fb-43af-8ad9-eb0be0f92e8c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:23:14.250015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9791b-25fb-43af-8ad9-eb0be0f92e8c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:23:14.253754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:23:14.254401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:14.254670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:14.254942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:14.265028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:23:14.266460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:23:14.276951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1205/2385] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:23:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:23:16.681382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001386f4-80db-49ef-a757-000fef990da3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:16.681890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001386f4-80db-49ef-a757-000fef990da3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:16.681994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001386f4-80db-49ef-a757-000fef990da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:16.699847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-001386f4-80db-49ef-a757-000fef990da3 None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:23:16.701016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-001386f4-80db-49ef-a757-000fef990da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:16.707929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1181/2386] 10.222.0.32 () {58 vars in 1009 bytes} [Mon May 23 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:23:16.719378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:23:16.730962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c57915-f02b-473b-b5d1-2eeb332945ee service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:23:16.736187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdff15-513f-4b1d-9af6-8dd76dbdf9f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:23:16.736821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdff15-513f-4b1d-9af6-8dd76dbdf9f4 service swift] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:16.737104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdff15-513f-4b1d-9af6-8dd76dbdf9f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:16.737381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdff15-513f-4b1d-9af6-8dd76dbdf9f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:16.745457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdff15-513f-4b1d-9af6-8dd76dbdf9f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:23:16.747650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdff15-513f-4b1d-9af6-8dd76dbdf9f4 service swift] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:23:16.755592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1206/2387] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 16:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:23:26.694833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=25 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:23:26.752338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=27 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:23:34.175404 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001386f4-80db-49ef-a757-000fef990da3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:23:34.176999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-001386f4-80db-49ef-a757-000fef990da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:34.245036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001386f4-80db-49ef-a757-000fef990da3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:23:34.248605 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027261-7114-486c-a231-53642906af2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:23:34.249254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027261-7114-486c-a231-53642906af2f service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:34.250091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027261-7114-486c-a231-53642906af2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:34.250373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027261-7114-486c-a231-53642906af2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:34.252673 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e5027261-7114-486c-a231-53642906af2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:34.323140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027261-7114-486c-a231-53642906af2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:23:34.324581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027261-7114-486c-a231-53642906af2f service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:23:34.334183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1182/2388] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:23:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:23:41.624534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:41.625082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:41.625082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:41.642742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] MFA Rules not processed for user `c9bdcccb57d14f44a4f93ced180dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:23:41.645693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:23:41.651378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1207/2389] 10.222.0.32 () {58 vars in 967 bytes} [Mon May 23 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:23:41.664237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027261-7114-486c-a231-53642906af2f service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:23:41.676532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027261-7114-486c-a231-53642906af2f service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:23:41.681961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2deaa48dbdb477f971178bd535395a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:23:41.683183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:23:41.683183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:23:41.683419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:23:41.692004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:23:41.693590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:23:41.710432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1183/2390] 10.222.0.32 () {60 vars in 1384 bytes} [Mon May 23 16:23:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:23:51.637920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:23:51.698642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=64 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:12.274020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:12.283500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ad06b-dcfc-4b08-87ef-8e9d583e2c1e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:12.287672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:12.288311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:12.288596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:12.288876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:12.290646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:12.302841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:12.304310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:12.313720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1208/2391] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:15.775864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:15.788178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b50be7-100d-4d7a-b23a-f84c9242f7fe service swift] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:15.793245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:15.793910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:15.794278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:15.795086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:15.796890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:15.809094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:15.810732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:15.820939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1184/2392] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:15.957987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:15.959490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:15.971696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865b8da-8f26-4985-a7c2-cd72ebad0bfd service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:15.976981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:15.977856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:15.978136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:15.978458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] PATH_INFO: `/v3/users/8b0a82159c6343d28546ec7c775b8791` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:15.979628 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0a82159c6343d28546ec7c775b8791)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:15.981553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:16.177305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0a82159c6343d28546ec7c775b8791'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.177958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0a82159c6343d28546ec7c775b8791'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.178561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0a82159c6343d28546ec7c775b8791'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.190397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0a82159c6343d28546ec7c775b8791'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.197838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-670f75f6-cec9-4669-ab0f-65a9d28e8365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0a82159c6343d28546ec7c775b8791'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.272752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1209/2393] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:15 2022] DELETE /identity/v3/users/8b0a82159c6343d28546ec7c775b8791 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:16.525785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:16.540168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a861ac0-e9b7-480c-b033-b47deb59090d service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:16.599704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:16.600575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:16.600859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:16.601138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] PATH_INFO: `/v3/projects/e80aa9835e9845e798b1c8346de141e3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:16.602312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80aa9835e9845e798b1c8346de141e3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:16.604518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:16.728209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80aa9835e9845e798b1c8346de141e3', 'request_id': 'req-b7f63ffd-b354-4690-a0d5-23bb98841308'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.733653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80aa9835e9845e798b1c8346de141e3', 'request_id': 'req-b7f63ffd-b354-4690-a0d5-23bb98841308'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.739984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80aa9835e9845e798b1c8346de141e3', 'request_id': 'req-b7f63ffd-b354-4690-a0d5-23bb98841308'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.823920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] The token cache is being invalidate because project e80aa9835e9845e798b1c8346de141e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:16.824554 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.824708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-b7f63ffd-b354-4690-a0d5-23bb98841308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:16.826273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1185/2394] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:16 2022] DELETE /identity/v3/projects/e80aa9835e9845e798b1c8346de141e3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:24:16.832725 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:16.833020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:16.833300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:16.877617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:16.879399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:16.935460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1210/2395] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:16.944309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:16.944602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:16.944884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:16.963563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:16.964828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:16.972892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1186/2396] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:16.976988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:16.986913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2541e1-6dbf-4b67-856f-224d2b8575e5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:16.991602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:16.992263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:16.992551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:16.992832 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:16.993562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:24:16.993874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:16.995519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.007642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1211/2397] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:24:17.011894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.021550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f8cf5-3677-49e0-99d5-c2823748c81f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.026096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.026740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.027023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.027335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.028018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.029894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.111538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1187/2398] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:17.116263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.126253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506bcc-fbf0-42c7-a782-a48ae41610b7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.146774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:17.183023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.183715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.184003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.184335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.185034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.186966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.284520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1212/2399] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:17 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:17.288817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.299156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c26b-96b7-4bfb-b502-4b3aadcb8f96 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.304405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.305103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.305388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.305666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.306406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.308070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.318881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1188/2400] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:17.323226 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.333300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ef63-70a3-412b-ace6-b74463db06b3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.337896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024000f3-ef43-45fc-a17f-a6516dc5225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.338572 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024000f3-ef43-45fc-a17f-a6516dc5225d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.338841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024000f3-ef43-45fc-a17f-a6516dc5225d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.339144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024000f3-ef43-45fc-a17f-a6516dc5225d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.339875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024000f3-ef43-45fc-a17f-a6516dc5225d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.341487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024000f3-ef43-45fc-a17f-a6516dc5225d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.351258 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1213/2401] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:17.355301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.365810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886cdae-ac01-467f-b392-2ebee84406e4 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.370392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.371388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.371675 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.371979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] PATH_INFO: `/v3/projects/dd1e21c816924493a7aab02cf9808a42/users/cad3d90ff5a04b34856c4d1391251b05/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.386790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1e21c816924493a7aab02cf9808a42, user_id=cad3d90ff5a04b34856c4d1391251b05, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.389508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.493507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1189/2402] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:17 2022] PUT /identity/v3/projects/dd1e21c816924493a7aab02cf9808a42/users/cad3d90ff5a04b34856c4d1391251b05/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:17.503888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.504254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.504626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.531392 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] MFA Rules not processed for user `cad3d90ff5a04b34856c4d1391251b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:17.532877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:17.598576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1214/2403] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:17.602956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.608653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:17.666163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741bb20-2d28-4b88-8b65-3ceb1cfd4234 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.671439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.676212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.676212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.676212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.676212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.676212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.793791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1190/2404] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:17.798038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:17.809338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a7d2-ed51-4413-b765-7bb1e17f7e03 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:17.865364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:17.866024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:17.866306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:17.866583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:17.867458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:17.869431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:17.986943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1215/2405] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:17 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:17.991578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:18.002008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1519c-d1ff-4e14-a837-e529485c2b52 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:18.007647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:18.008313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.008595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.008873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.009604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:18.011241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:18.022001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1191/2406] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:18.026312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:18.036937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6886-1a67-4d0e-9374-5b3ebfde2c8b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:18.041606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:18.042485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.042768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.043046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] PATH_INFO: `/v3/projects/9bc1cc16b2854515884b2bf257d1b0f7/users/723dd2154ba14b8182a26876307a0d5a/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.057981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc1cc16b2854515884b2bf257d1b0f7, user_id=723dd2154ba14b8182a26876307a0d5a, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:18.060685 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:18.124265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:18.130341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1216/2407] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:18 2022] PUT /identity/v3/projects/9bc1cc16b2854515884b2bf257d1b0f7/users/723dd2154ba14b8182a26876307a0d5a/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:24:18.134459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:18.144491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ce72-089b-4d28-8d54-2915040b0681 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:18.200325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b8c4b-2182-4bc1-aca0-3fc26a279374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:18.200985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8c4b-2182-4bc1-aca0-3fc26a279374 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.201271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8c4b-2182-4bc1-aca0-3fc26a279374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.201548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8c4b-2182-4bc1-aca0-3fc26a279374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.202265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b8c4b-2182-4bc1-aca0-3fc26a279374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:18.203913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b8c4b-2182-4bc1-aca0-3fc26a279374 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:18.213463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1192/2408] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:18.217752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:18.228271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45ad7-c316-46e4-8c08-fb07b334aba5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:18.233519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:18.234665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.235019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.235918 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] PATH_INFO: `/v3/projects/9bc1cc16b2854515884b2bf257d1b0f7/users/723dd2154ba14b8182a26876307a0d5a/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.237641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc1cc16b2854515884b2bf257d1b0f7, user_id=723dd2154ba14b8182a26876307a0d5a, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:18.240916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:18.251593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1217/2409] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:18 2022] PUT /identity/v3/projects/9bc1cc16b2854515884b2bf257d1b0f7/users/723dd2154ba14b8182a26876307a0d5a/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:24:18.276074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.276308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.276589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.305472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] MFA Rules not processed for user `723dd2154ba14b8182a26876307a0d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:18.306717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:18.370157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:18.373662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1193/2410] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:18.385919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:18.387638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:18.444436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03594f20-686d-40af-ac38-105c475aa94f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:18.448082 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:18.448923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.449217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.449499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.458585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:18.460068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:18.469538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1218/2411] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:18.564375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:18.565773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:18.578104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5782d7-84e0-42bd-ab34-eeaedd75af94 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:18.581643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37571fee-704c-4d68-8ef1-1af94beead1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:18.582889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37571fee-704c-4d68-8ef1-1af94beead1e service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:18.583209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37571fee-704c-4d68-8ef1-1af94beead1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:18.583490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37571fee-704c-4d68-8ef1-1af94beead1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:18.638811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37571fee-704c-4d68-8ef1-1af94beead1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:18.640270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37571fee-704c-4d68-8ef1-1af94beead1e service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:18.649009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1194/2412] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:21.793834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:21.855080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe328e-9555-4d81-bdd5-faa041d63509 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:21.859745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:21.860607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:21.860893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:21.861170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] PATH_INFO: `/v3/users/cad3d90ff5a04b34856c4d1391251b05` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:21.862346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad3d90ff5a04b34856c4d1391251b05)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:21.864359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:22.078683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad3d90ff5a04b34856c4d1391251b05'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.079282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad3d90ff5a04b34856c4d1391251b05'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.079997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad3d90ff5a04b34856c4d1391251b05'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.092135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad3d90ff5a04b34856c4d1391251b05'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.098811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad3d90ff5a04b34856c4d1391251b05'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.191920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1219/2413] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:21 2022] DELETE /identity/v3/users/cad3d90ff5a04b34856c4d1391251b05 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:22.196659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:22.197175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:22.197297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:22.214755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:22.216131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:22.274211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1195/2414] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:22.284057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:22.285472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:22.296233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:22.351830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0686-c601-4fa9-aa9b-1e514f3934e9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:22.357722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:22.358366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:22.358646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:22.358921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:22.368098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:22.369514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:22.379513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1220/2415] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:22.787309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:22.795431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:22.807523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5516-e2cf-449c-9820-20a13a42f317 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:22.812720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:22.813681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:22.813953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:22.814165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] PATH_INFO: `/v3/projects/dd1e21c816924493a7aab02cf9808a42` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:22.815400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1e21c816924493a7aab02cf9808a42)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:22.817326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:22.947640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1e21c816924493a7aab02cf9808a42', 'request_id': 'req-95b47323-5f7f-4adb-a9c4-17866d5bd099'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.953301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1e21c816924493a7aab02cf9808a42', 'request_id': 'req-95b47323-5f7f-4adb-a9c4-17866d5bd099'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:22.959530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1e21c816924493a7aab02cf9808a42', 'request_id': 'req-95b47323-5f7f-4adb-a9c4-17866d5bd099'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.037989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] The token cache is being invalidate because project dd1e21c816924493a7aab02cf9808a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:23.038288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.039963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.041684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1196/2416] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:22 2022] DELETE /identity/v3/projects/dd1e21c816924493a7aab02cf9808a42 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:24:23.046640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:23.057218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03688093-c720-4e61-bc22-a41bbf297857 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:23.114318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:23.115228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:23.115517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:23.115814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] PATH_INFO: `/v3/users/723dd2154ba14b8182a26876307a0d5a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:23.117479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] RBAC: Authorizing `identity:delete_user(user_id=723dd2154ba14b8182a26876307a0d5a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:23.119459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:23.332518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723dd2154ba14b8182a26876307a0d5a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.333176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723dd2154ba14b8182a26876307a0d5a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.333788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723dd2154ba14b8182a26876307a0d5a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.347481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723dd2154ba14b8182a26876307a0d5a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.360653 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-40188cd2-20d7-4240-8a4b-07cf5675662e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723dd2154ba14b8182a26876307a0d5a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:23.459605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1221/2417] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:23 2022] DELETE /identity/v3/users/723dd2154ba14b8182a26876307a0d5a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:23.965826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:23.967314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:23.981453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b47323-5f7f-4adb-a9c4-17866d5bd099 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.000025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:24.040654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.041531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.041811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.042115 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] PATH_INFO: `/v3/projects/9bc1cc16b2854515884b2bf257d1b0f7` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.043297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc1cc16b2854515884b2bf257d1b0f7)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.045249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.153052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc1cc16b2854515884b2bf257d1b0f7', 'request_id': 'req-771b45b4-1f8c-4ac8-b306-a33e7095b228'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:24.159014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc1cc16b2854515884b2bf257d1b0f7', 'request_id': 'req-771b45b4-1f8c-4ac8-b306-a33e7095b228'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:24.165476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc1cc16b2854515884b2bf257d1b0f7', 'request_id': 'req-771b45b4-1f8c-4ac8-b306-a33e7095b228'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:24.244118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] The token cache is being invalidate because project 9bc1cc16b2854515884b2bf257d1b0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:24.244411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:24.245045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-771b45b4-1f8c-4ac8-b306-a33e7095b228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:24.246754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1197/2418] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:23 2022] DELETE /identity/v3/projects/9bc1cc16b2854515884b2bf257d1b0f7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:24.251737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.252209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.252301 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.273565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:24.274776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:24.298785 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:24.333038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1222/2419] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:24.345372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.345642 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.345919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.363955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:24.365145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:24.372939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1198/2420] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:24.377107 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:24.387579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdece5f2-be19-4026-92b0-dbc944612cd0 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.392495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.393149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.393439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.393722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.394488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:24:24.394804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.396468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.408842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1223/2421] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:24:24.413104 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:24.422890 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616076d1-e425-4e26-8b91-6175cdb65995 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.427649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.428313 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.428609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.428895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.429598 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.431543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.525865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1199/2422] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:24:24.530088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:24.540478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c9b0d-c43f-4bdb-ad4d-ae7a798c5721 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.597371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.598039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.598319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.598595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.599323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.601242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.677986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1224/2423] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:24 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:24.682697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:24.693318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ac68e-9739-4364-8f3a-c08fd8af5c78 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.698777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.699528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.699769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.700052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.700786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.702391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.713059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1200/2424] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:24.718573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:24.728909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fed9a-96d5-4f3c-9a12-afdd9be0534b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.733539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f61a5-3436-4883-b30b-872d2276a118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.734201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f61a5-3436-4883-b30b-872d2276a118 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.734486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f61a5-3436-4883-b30b-872d2276a118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.734764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f61a5-3436-4883-b30b-872d2276a118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.735545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f61a5-3436-4883-b30b-872d2276a118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.737197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f61a5-3436-4883-b30b-872d2276a118 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.749609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1225/2425] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:24.753651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:24.764658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d070f-49f1-46da-a71b-8f5af0c79200 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:24.769908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:24.770804 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.771272 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.771557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] PATH_INFO: `/v3/projects/69102fbf46224cb4a6e2d2682326f783/users/222dd548f733446680965ec144546157/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.788107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] RBAC: Authorizing `identity:create_grant(project_id=69102fbf46224cb4a6e2d2682326f783, user_id=222dd548f733446680965ec144546157, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:24.791578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:24.901250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1201/2426] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:24 2022] PUT /identity/v3/projects/69102fbf46224cb4a6e2d2682326f783/users/222dd548f733446680965ec144546157/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:24.911700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:24.911992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:24.912263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:24.939311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] MFA Rules not processed for user `222dd548f733446680965ec144546157`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:24.940511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:25.003644 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1226/2427] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:25.007745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.058145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:25.070609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9688-fdb5-4ef5-946e-645206c222af admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.075280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.075934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.076217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.076494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.077176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.079066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.191579 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1202/2428] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:25 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:25.195466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.205995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef6a86-48ca-4d4c-8521-32ad64ef4b6a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.225602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:25.265976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.268720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.268720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.268720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.268720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.269960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.345371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1227/2429] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:25 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:25.349496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.360543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90db37-96db-4eb9-8409-6730082562a3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.365248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.365942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.366232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.366514 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.367333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.369013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.380550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1203/2430] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:25.387815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.398495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2db0-5ec4-461a-83d7-eefd5fd74235 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.403354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.404443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.405160 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.405425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] PATH_INFO: `/v3/projects/4505f86a48954b3899ce5c2296a984c6/users/9e689a8d49a34e10aa237407af58d82e/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.421036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4505f86a48954b3899ce5c2296a984c6, user_id=9e689a8d49a34e10aa237407af58d82e, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.423762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.518296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1228/2431] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:25 2022] PUT /identity/v3/projects/4505f86a48954b3899ce5c2296a984c6/users/9e689a8d49a34e10aa237407af58d82e/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:25.522373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.533329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a4ec-b3c0-4481-985f-654d3415ec28 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.589405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe8fda-dd09-4b15-938d-b6c901e6243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.590150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8fda-dd09-4b15-938d-b6c901e6243e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.590433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8fda-dd09-4b15-938d-b6c901e6243e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.590704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8fda-dd09-4b15-938d-b6c901e6243e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.591556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8fda-dd09-4b15-938d-b6c901e6243e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.593229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8fda-dd09-4b15-938d-b6c901e6243e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.603725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1204/2432] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:25.608008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.618308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25975-ccec-4714-a100-153894274c42 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.622919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.623829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.624116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.624399 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] PATH_INFO: `/v3/projects/4505f86a48954b3899ce5c2296a984c6/users/9e689a8d49a34e10aa237407af58d82e/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.626360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4505f86a48954b3899ce5c2296a984c6, user_id=9e689a8d49a34e10aa237407af58d82e, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.629062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.639766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1229/2433] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:25 2022] PUT /identity/v3/projects/4505f86a48954b3899ce5c2296a984c6/users/9e689a8d49a34e10aa237407af58d82e/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:25.651516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.651808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.652089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.677871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] MFA Rules not processed for user `9e689a8d49a34e10aa237407af58d82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:25.679112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:25.744533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1205/2434] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:25.755144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:25.757565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:25.814168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6fd8b-6027-4a75-8377-f10fe2f61486 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:25.818250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:25.818898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:25.819233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:25.820179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:25.829728 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:25.831217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:25.842778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1230/2435] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:26.314754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:26.359807 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:26.377020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feb3c0-3c30-4ea3-8ed1-177ac30cb948 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:26.378497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:26.379994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:26.381703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:26.383205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:26.383493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:26.383775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] PATH_INFO: `/v3/users/222dd548f733446680965ec144546157` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:26.385007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222dd548f733446680965ec144546157)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:26.387031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:26.454632 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65e7e-1c31-4586-8a2a-bd9600b99ce2 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:26.460213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:26.460863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:26.461152 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:26.461436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:26.463249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:26.481283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:26.533568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:26.535197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626115-1f66-4835-9c94-b159e6e03a1d service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:26.544873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1231/2436] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:26.553606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222dd548f733446680965ec144546157'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:26.626751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222dd548f733446680965ec144546157'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:26.627431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222dd548f733446680965ec144546157'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:26.640356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222dd548f733446680965ec144546157'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:26.647224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222dd548f733446680965ec144546157'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:26.653498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1206/2437] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:26 2022] DELETE /identity/v3/users/222dd548f733446680965ec144546157 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:26.661894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:26.662446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:26.662922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:26.682579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:26.683905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:26.743772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1232/2438] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:26.753507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:26.754934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:26.818757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb83c3-5603-4c5d-8bc7-dd3296cc1a67 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:26.822584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:26.823279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:26.823563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:26.824005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:26.833395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:26.834819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:26.845403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1207/2439] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:27.245540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:27.246994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:27.259542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e90f9-57d5-4a22-8605-3a7fd33837cd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:27.264527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:27.265509 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:27.265899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:27.266235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] PATH_INFO: `/v3/projects/69102fbf46224cb4a6e2d2682326f783` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:27.267559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69102fbf46224cb4a6e2d2682326f783)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:27.269563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:27.417359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69102fbf46224cb4a6e2d2682326f783', 'request_id': 'req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.509922 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69102fbf46224cb4a6e2d2682326f783', 'request_id': 'req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.516560 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69102fbf46224cb4a6e2d2682326f783', 'request_id': 'req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.527599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] The token cache is being invalidate because project 69102fbf46224cb4a6e2d2682326f783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:27.527887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.528506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.530037 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1233/2440] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:27 2022] DELETE /identity/v3/projects/69102fbf46224cb4a6e2d2682326f783 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:27.534284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:27.544016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49beb1b-b4e6-4841-aea1-e5f0791c43b4 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:27.599456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:27.600323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:27.600626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:27.600916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] PATH_INFO: `/v3/users/9e689a8d49a34e10aa237407af58d82e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:27.602093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e689a8d49a34e10aa237407af58d82e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:27.604045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:27.609835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:27.805762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e689a8d49a34e10aa237407af58d82e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.872158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e689a8d49a34e10aa237407af58d82e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.872772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e689a8d49a34e10aa237407af58d82e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.885244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e689a8d49a34e10aa237407af58d82e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.891993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a7c1e8d7-b09d-4e4c-9906-dcf7e0b961b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e689a8d49a34e10aa237407af58d82e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:27.897927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1208/2441] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:27 2022] DELETE /identity/v3/users/9e689a8d49a34e10aa237407af58d82e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:28.302067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:28.303609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:28.317639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f361-1a06-4e6d-9436-d5b4112aa6d4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:28.346142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:28.379448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:28.380308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:28.380595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:28.383423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] PATH_INFO: `/v3/projects/4505f86a48954b3899ce5c2296a984c6` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:28.384709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4505f86a48954b3899ce5c2296a984c6)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:28.387376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:28.484516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4505f86a48954b3899ce5c2296a984c6', 'request_id': 'req-35e67d3a-7749-4c68-9681-8cdd3fe09d71'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:28.526489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4505f86a48954b3899ce5c2296a984c6', 'request_id': 'req-35e67d3a-7749-4c68-9681-8cdd3fe09d71'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:28.532655 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4505f86a48954b3899ce5c2296a984c6', 'request_id': 'req-35e67d3a-7749-4c68-9681-8cdd3fe09d71'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:28.543783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] The token cache is being invalidate because project 4505f86a48954b3899ce5c2296a984c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:28.544123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:28.544771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-35e67d3a-7749-4c68-9681-8cdd3fe09d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:28.546365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1234/2442] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:28 2022] DELETE /identity/v3/projects/4505f86a48954b3899ce5c2296a984c6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:28.551936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:28.552403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:28.552529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:28.570449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:28.571680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:28.629544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1209/2443] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:28.637460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:28.637751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:28.638046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:28.656750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:28.658219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:28.666162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1235/2444] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:28.670479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:28.680212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b95d3-f81b-415b-92ef-f5cd607e1da1 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:28.684773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:28.685430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:28.685716 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:28.686000 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:28.686725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:24:28.687062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:28.688698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:28.700436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1210/2445] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:24:28.704441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:28.714077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb487d-24d2-4de0-9d0e-eed46e8136ad None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:28.718623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:28.719292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:28.719576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:28.719850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:28.720547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:28.722444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:28.843700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1236/2446] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:28 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:28.847919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:28.858060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611411-0300-41b3-80c2-6a43b78ee706 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:28.914488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:28.915080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:28.915389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:28.915666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:28.916349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:28.918343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:28.990181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1211/2447] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:28 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:28.994106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:29.004602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97403a65-cad5-4eab-9a51-4b0a5eb194ba admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:29.009843 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:29.010666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:29.011019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:29.011270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:29.012005 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:29.013608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:29.024840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1237/2448] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:29.028796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:29.034677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:29.040164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5525f3-64d0-40e2-b514-6799c4dc4dfa admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:29.044967 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf158e3-74e7-489f-ae5f-ddf749eb8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:29.045667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf158e3-74e7-489f-ae5f-ddf749eb8da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:29.045946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf158e3-74e7-489f-ae5f-ddf749eb8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:29.046223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf158e3-74e7-489f-ae5f-ddf749eb8da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:29.046944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf158e3-74e7-489f-ae5f-ddf749eb8da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:29.048603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf158e3-74e7-489f-ae5f-ddf749eb8da3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:29.058912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1212/2449] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:29.063001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:29.073514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb02e1-c292-46db-80e3-6d51fe8bcac9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:29.078138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:29.079002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:29.079311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:29.079699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] PATH_INFO: `/v3/projects/f4515006c35b43628bcb23c3fe0f3c2c/users/6d11de4d13d7415387db68d0c7d01c6c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:29.093937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4515006c35b43628bcb23c3fe0f3c2c, user_id=6d11de4d13d7415387db68d0c7d01c6c, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:29.096620 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:29.190241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1238/2450] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:29 2022] PUT /identity/v3/projects/f4515006c35b43628bcb23c3fe0f3c2c/users/6d11de4d13d7415387db68d0c7d01c6c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:29.200919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:29.201281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:29.207235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:29.229611 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] MFA Rules not processed for user `6d11de4d13d7415387db68d0c7d01c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:29.230932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:29.300614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1213/2451] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:29.312203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:29.313884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:29.371859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332b4d-5a46-4109-8b7f-3dfead0c097b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:29.375571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d6df3eff264a17a0b970c7fa9eef65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:29.376224 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:29.376511 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:29.376790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:29.386128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:29.387683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:29.391329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:29.398019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1239/2452] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:34.356880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:34.360177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:34.441739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73483800-33d5-4c35-93a5-e587d04ee6c3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:34.447484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:34.447924 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:34.448208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:34.448490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:34.450265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:34.461998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:34.463610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:34.473432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1214/2453] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:39.529024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:44.469324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=73 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:48.695744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:48.697185 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:48.760547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948fe0c-621a-4ac6-a59a-489220d879aa service glance] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:48.764103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:48.764743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:48.765029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:48.765309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:48.767227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:48.838491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:48.839992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:48.848953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1240/2454] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:51.169936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:51.171417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:51.226507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383817-dc83-43c3-a6fd-8bf4f99b9939 service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:51.230682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:51.231370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:51.231696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:51.231976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:51.233815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:51.297726 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:51.299224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:51.309214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1215/2455] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:55.221542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:55.223039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:55.241893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28af1-4c6f-4457-8132-3b6d8c99b171 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:55.247822 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:55.248777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:55.249159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:55.249569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] PATH_INFO: `/v3/users/72deeff329a6482cbfdb828a1996b127` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:55.250880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72deeff329a6482cbfdb828a1996b127)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:55.253287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:55.496281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72deeff329a6482cbfdb828a1996b127'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:55.496946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72deeff329a6482cbfdb828a1996b127'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:55.497647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72deeff329a6482cbfdb828a1996b127'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:55.509951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72deeff329a6482cbfdb828a1996b127'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:55.517978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d0ac4d62-7429-43c6-92a0-dfddd0b00b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72deeff329a6482cbfdb828a1996b127'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:55.595338 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1241/2456] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:55 2022] DELETE /identity/v3/users/72deeff329a6482cbfdb828a1996b127 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:55.884624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:55.894403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ce32-e146-44fe-94f5-5a7296503fe5 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:55.950699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:55.951597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:55.951914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:55.952193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] PATH_INFO: `/v3/projects/f474f456861e40ee9eb654852f80f313` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:55.953367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f474f456861e40ee9eb654852f80f313)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:55.955317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.061149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f474f456861e40ee9eb654852f80f313', 'request_id': 'req-d602678b-a18f-4a1e-b235-54b23e22b250'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:56.063190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:56.067330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f474f456861e40ee9eb654852f80f313', 'request_id': 'req-d602678b-a18f-4a1e-b235-54b23e22b250'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:56.074194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f474f456861e40ee9eb654852f80f313', 'request_id': 'req-d602678b-a18f-4a1e-b235-54b23e22b250'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:56.181283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] The token cache is being invalidate because project f474f456861e40ee9eb654852f80f313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:56.181653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:56.182283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d602678b-a18f-4a1e-b235-54b23e22b250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:56.183864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1216/2457] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:55 2022] DELETE /identity/v3/projects/f474f456861e40ee9eb654852f80f313 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:56.188757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.189046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.189323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.207645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:56.212580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:56.218700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:56.268154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1242/2458] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:56.276009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.276356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.276666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.296108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:56.297316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:56.305280 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1217/2459] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:56.309492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:56.319678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3484-5b12-4455-b1e8-8d9412196ae2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:56.325020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:56.325808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.326157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.326498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.327348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:24:56.327873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:56.329384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.341938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1243/2460] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:24:56.346177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:56.358073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db8f4-6431-4c31-9e8f-3d5701658d14 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:56.360601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:56.361257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.361547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.361828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.362532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:56.364468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.465486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1218/2461] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:56 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:56.469296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:56.479844 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb44e-e5c7-4900-8551-15de8fa040cd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:56.557579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:56.557579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.557579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.557579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.557886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:56.557886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.625627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1244/2462] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:56 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:24:56.626998 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:56.638006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72899303-ea16-402a-b888-be33cdf11aa6 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:56.642745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:56.643460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.643834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.644116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.644845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:56.646431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.658772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1219/2463] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:56.662615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:56.673116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43341-0e40-49bf-bbe6-a1d352461f8c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:56.683668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79bb0-503a-48e1-b7c2-03c38cbb829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:56.684706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79bb0-503a-48e1-b7c2-03c38cbb829d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.685190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79bb0-503a-48e1-b7c2-03c38cbb829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.685809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79bb0-503a-48e1-b7c2-03c38cbb829d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.687425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d79bb0-503a-48e1-b7c2-03c38cbb829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:56.689487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d79bb0-503a-48e1-b7c2-03c38cbb829d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.706734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1245/2464] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:56.707906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:56.718793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5072fe-937d-4efc-b3de-fab893300900 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:56.723938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:56.724844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.725136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.725421 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] PATH_INFO: `/v3/projects/946a1f99813941f38337fe9f74b4f06c/users/9c060aaea58c4d398eee8ba8256aa9c2/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.743783 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=946a1f99813941f38337fe9f74b4f06c, user_id=9c060aaea58c4d398eee8ba8256aa9c2, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:56.747057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:56.866715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1220/2465] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:56 2022] PUT /identity/v3/projects/946a1f99813941f38337fe9f74b4f06c/users/9c060aaea58c4d398eee8ba8256aa9c2/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:56.877569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef999-4097-455a-9a64-e747b898e90a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:56.877936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef999-4097-455a-9a64-e747b898e90a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:56.878361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef999-4097-455a-9a64-e747b898e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:56.908766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0feef999-4097-455a-9a64-e747b898e90a None None] MFA Rules not processed for user `9c060aaea58c4d398eee8ba8256aa9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:56.909994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0feef999-4097-455a-9a64-e747b898e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:56.978970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1246/2466] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:56.983587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.053114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01fb46-f750-4ea9-af82-3e9131c368f8 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.059222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.062833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.062833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.062833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.062833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.063354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.139775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1221/2467] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:56 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:57.143648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef999-4097-455a-9a64-e747b898e90a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.154256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef999-4097-455a-9a64-e747b898e90a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.162202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:57.214814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.215610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.215889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.216168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.216877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.218874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.324609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1247/2468] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:24:57 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:24:57.328555 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.338915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a28ab-2970-4cfa-8c46-614fb71d5d11 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.343543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.344198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.344496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.344800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.345509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.347158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.358905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1222/2469] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:57.363013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.374046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098ccd6-cff5-4c12-a84d-35b6d21b94c9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.378681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.384136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.384136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.384136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] PATH_INFO: `/v3/projects/85a802f7c2074f589cf0df37f103d641/users/491056c0df6e431daca5c09502318424/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.395876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a802f7c2074f589cf0df37f103d641, user_id=491056c0df6e431daca5c09502318424, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.398587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.495202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1248/2470] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:57 2022] PUT /identity/v3/projects/85a802f7c2074f589cf0df37f103d641/users/491056c0df6e431daca5c09502318424/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:57.499167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.509125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9f22d-9423-4266-83ce-fcc21d0c5758 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.555815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:57.564849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ec253-22f8-4687-95e4-416b1a711e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.565532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ec253-22f8-4687-95e4-416b1a711e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.566071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ec253-22f8-4687-95e4-416b1a711e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.566360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ec253-22f8-4687-95e4-416b1a711e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.567074 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ec253-22f8-4687-95e4-416b1a711e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.568733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ec253-22f8-4687-95e4-416b1a711e70 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.578958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1223/2471] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:24:57.582972 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.594103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986abe-e2c8-42ee-8935-46bbafa5c2a0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.598765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.599985 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.600276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.600555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] PATH_INFO: `/v3/projects/85a802f7c2074f589cf0df37f103d641/users/491056c0df6e431daca5c09502318424/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.602610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a802f7c2074f589cf0df37f103d641, user_id=491056c0df6e431daca5c09502318424, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.605419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.616330 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1249/2472] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:24:57 2022] PUT /identity/v3/projects/85a802f7c2074f589cf0df37f103d641/users/491056c0df6e431daca5c09502318424/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:57.627569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.627862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.628147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.654666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] MFA Rules not processed for user `491056c0df6e431daca5c09502318424`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:57.655895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:57.722838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1224/2473] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:57.734869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.737102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:57.800484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82e14d-4310-4d20-bdd4-28f21b03cd8b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.804283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.804964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.805252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.805534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.815569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.817016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.832079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1250/2474] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:57.833357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:57.834792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:57.891856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157ff6-b07a-4d74-80cf-bd3df70de869 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:57.895433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:57.896075 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:57.896360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:57.896631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:57.898388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:57.962672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:57.964458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68659f57-a442-47b4-bce9-11468c2fd1fb service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:57.974901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1225/2475] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:58.105583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:58.106978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:58.120364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491ca47-ba80-4173-a55d-6bcce7624482 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:58.129689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:58.129689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:58.129689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:58.129689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] PATH_INFO: `/v3/users/6d11de4d13d7415387db68d0c7d01c6c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:58.131670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d11de4d13d7415387db68d0c7d01c6c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:58.133689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:58.303773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d11de4d13d7415387db68d0c7d01c6c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:58.304950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d11de4d13d7415387db68d0c7d01c6c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:58.305184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d11de4d13d7415387db68d0c7d01c6c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:58.318217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:58.320219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d11de4d13d7415387db68d0c7d01c6c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:58.327772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d11de4d13d7415387db68d0c7d01c6c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:58.403735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1251/2476] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:58 2022] DELETE /identity/v3/users/6d11de4d13d7415387db68d0c7d01c6c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:58.412596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:58.413091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:58.413632 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:58.435219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:58.436533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:58.456841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:58.512568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1226/2477] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:58.527373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:58.530056 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:58.589937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be414-837c-4a98-b921-664c58ca28c7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:58.594127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506491c4-1f93-4c41-a01c-17ad552a7493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:58.594907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506491c4-1f93-4c41-a01c-17ad552a7493 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:58.595321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506491c4-1f93-4c41-a01c-17ad552a7493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:58.595704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506491c4-1f93-4c41-a01c-17ad552a7493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:58.607210 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506491c4-1f93-4c41-a01c-17ad552a7493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:58.608779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506491c4-1f93-4c41-a01c-17ad552a7493 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:58.619363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1252/2478] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:58.735682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:58.737108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:58.749584 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252c9b-5fd8-4b1f-9ae2-df85e6554282 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:58.754324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:58.755013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:58.755321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:58.755589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] PATH_INFO: `/v3/users/9c060aaea58c4d398eee8ba8256aa9c2` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:58.757544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c060aaea58c4d398eee8ba8256aa9c2)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:58.759004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:59.107831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c060aaea58c4d398eee8ba8256aa9c2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.184166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c060aaea58c4d398eee8ba8256aa9c2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.184828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c060aaea58c4d398eee8ba8256aa9c2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.200349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c060aaea58c4d398eee8ba8256aa9c2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.211452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c060aaea58c4d398eee8ba8256aa9c2'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.219343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1227/2479] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:24:58 2022] DELETE /identity/v3/users/9c060aaea58c4d398eee8ba8256aa9c2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:59.238599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.238965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.239541 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.260280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:59.261540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:59.323193 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1253/2480] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:59.333489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:59.334927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:59.371168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:59.372623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:59.385874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a0aa4-267c-463d-8f53-39ff86df52eb None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:59.394416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:59.395759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.396148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.396524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] PATH_INFO: `/v3/projects/f4515006c35b43628bcb23c3fe0f3c2c` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.398003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4515006c35b43628bcb23c3fe0f3c2c)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:59.400391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:59.421945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d434af-c5fb-4190-8637-c730289d92a9 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:59.426330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e34d-d652-45b2-88ac-7981efaf2091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:59.426965 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e34d-d652-45b2-88ac-7981efaf2091 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.427276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e34d-d652-45b2-88ac-7981efaf2091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.427558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e34d-d652-45b2-88ac-7981efaf2091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.438029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e34d-d652-45b2-88ac-7981efaf2091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:59.439543 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e34d-d652-45b2-88ac-7981efaf2091 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:59.451053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1228/2481] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:24:59.539743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4515006c35b43628bcb23c3fe0f3c2c', 'request_id': 'req-9ef2c72a-89ae-4dff-8460-27ee06d615e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.609149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4515006c35b43628bcb23c3fe0f3c2c', 'request_id': 'req-9ef2c72a-89ae-4dff-8460-27ee06d615e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.616609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4515006c35b43628bcb23c3fe0f3c2c', 'request_id': 'req-9ef2c72a-89ae-4dff-8460-27ee06d615e3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.628213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] The token cache is being invalidate because project f4515006c35b43628bcb23c3fe0f3c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:24:59.628614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.629383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9ef2c72a-89ae-4dff-8460-27ee06d615e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:24:59.630958 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1254/2482] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:59 2022] DELETE /identity/v3/projects/f4515006c35b43628bcb23c3fe0f3c2c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:24:59.635896 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.636261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.636537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.656448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:59.657879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:59.696492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:59.727963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1229/2483] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:59.786585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.786873 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.787346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.795205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:24:59.807087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:24:59.808334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:24:59.817597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1255/2484] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:24:59.822073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:59.833207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea1e96-fb0f-48b2-9581-7f8fcf2f5601 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:59.838211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:59.838929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.839305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.839593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.840335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:24:59.840703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:59.842328 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:59.862524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1230/2485] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:24:59.865899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:59.876695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd65d1-0747-420d-bf46-3f0b26ff8400 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:24:59.881645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:24:59.882306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:24:59.882610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:24:59.882883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:24:59.885507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:24:59.885602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:24:59.997851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:24:59.999786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:00.013841 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1256/2486] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:24:59 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:00.017460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:00.026515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5ad2-6be1-4a98-918e-a34fadaea80b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.110665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.111691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.111973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.112304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] PATH_INFO: `/v3/projects/946a1f99813941f38337fe9f74b4f06c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.113501 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=946a1f99813941f38337fe9f74b4f06c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.115469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.123734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997cf0-4111-46b5-9614-5e6fdcddd320 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.128790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.129462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.129749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.130027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.130723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.132690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.233292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1257/2487] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:00 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:00.237627 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:00.252104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b3848-eceb-484b-80f2-256b21cffc9c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.257327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.258062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.258358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.258638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.259764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.261488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.275161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1258/2488] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:00.276104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:00.280229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946a1f99813941f38337fe9f74b4f06c', 'request_id': 'req-ba70948b-e75c-4129-8ac2-f72a7165b476'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.286857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc55c71-e76b-43d6-9961-c550ec2c9fef admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.287191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946a1f99813941f38337fe9f74b4f06c', 'request_id': 'req-ba70948b-e75c-4129-8ac2-f72a7165b476'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.301614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946a1f99813941f38337fe9f74b4f06c', 'request_id': 'req-ba70948b-e75c-4129-8ac2-f72a7165b476'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.350049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.350721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.351010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.351339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.352134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.354194 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.368708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1259/2489] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:00.373433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:00.378774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] The token cache is being invalidate because project 946a1f99813941f38337fe9f74b4f06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:00.378774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.378774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.378774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1231/2490] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:24:59 2022] DELETE /identity/v3/projects/946a1f99813941f38337fe9f74b4f06c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:00.382525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:00.385188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:00.389052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c53af-20f5-4a3c-b6f4-ccd6c0a83213 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.393953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dcc96-5123-4af5-8bdc-0aab2178d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.395020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dcc96-5123-4af5-8bdc-0aab2178d714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.395333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dcc96-5123-4af5-8bdc-0aab2178d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.395618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dcc96-5123-4af5-8bdc-0aab2178d714 admin admin] PATH_INFO: `/v3/projects/bdc9364cabe147249c89e4a9042776d6/users/b142b68adb024fe89a131af18c4cc2f6/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.404310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70948b-e75c-4129-8ac2-f72a7165b476 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.413251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.414443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dcc96-5123-4af5-8bdc-0aab2178d714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc9364cabe147249c89e4a9042776d6, user_id=b142b68adb024fe89a131af18c4cc2f6, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.415423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.416132 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.416708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] PATH_INFO: `/v3/users/491056c0df6e431daca5c09502318424` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.417176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dcc96-5123-4af5-8bdc-0aab2178d714 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.421791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491056c0df6e431daca5c09502318424)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.424586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.506974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1260/2491] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:00 2022] PUT /identity/v3/projects/bdc9364cabe147249c89e4a9042776d6/users/b142b68adb024fe89a131af18c4cc2f6/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:00.517405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.517622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.517904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.548776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] MFA Rules not processed for user `b142b68adb024fe89a131af18c4cc2f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:00.550745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:00.565505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:00.617237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1261/2492] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:00.631275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491056c0df6e431daca5c09502318424'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.633835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:00.636610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:00.638237 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:00.703684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df69109-1bcb-4c13-afa4-261ad63607fc None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:00.707529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:00.708177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:00.708458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:00.708737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:00.717984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:00.719504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:00.728723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1262/2493] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:25:00.734640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491056c0df6e431daca5c09502318424'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.736092 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491056c0df6e431daca5c09502318424'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.750845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491056c0df6e431daca5c09502318424'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.757818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ea469663-34da-424b-9353-615f4277fa36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491056c0df6e431daca5c09502318424'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:00.765550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1232/2494] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:00 2022] DELETE /identity/v3/users/491056c0df6e431daca5c09502318424 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:01.269882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:01.359054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3db3-6fea-4f68-b333-9de72094a656 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:01.462077 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:01.463054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:01.465461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:01.465461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] PATH_INFO: `/v3/projects/85a802f7c2074f589cf0df37f103d641` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:01.466219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a802f7c2074f589cf0df37f103d641)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:01.468387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:01.487159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:01.682102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a802f7c2074f589cf0df37f103d641', 'request_id': 'req-99271e83-1986-4e67-a3e7-062869e45525'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:01.750971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a802f7c2074f589cf0df37f103d641', 'request_id': 'req-99271e83-1986-4e67-a3e7-062869e45525'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:01.759332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a802f7c2074f589cf0df37f103d641', 'request_id': 'req-99271e83-1986-4e67-a3e7-062869e45525'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:01.776942 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] The token cache is being invalidate because project 85a802f7c2074f589cf0df37f103d641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:01.777229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:01.779285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-99271e83-1986-4e67-a3e7-062869e45525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:01.783174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1263/2495] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:01 2022] DELETE /identity/v3/projects/85a802f7c2074f589cf0df37f103d641 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:01.786761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:01.787271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:01.787356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:01.808400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:01.816546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:01.900720 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1233/2496] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:01.909024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:01.909326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:01.909609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:01.931559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:01.932955 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:01.942034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1264/2497] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:01.946257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:01.957430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f178d-3858-4260-b7b0-8591f1166c26 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:01.967057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:01.967989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:01.968441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:01.970131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:01.971170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:01.971670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:01.973471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:01.988180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1234/2498] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:02.001473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.016108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff5d4-ff79-40af-96d5-599750373c68 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.022001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.025824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.026634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.026988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.027815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.033792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.136346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1265/2499] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:02.137942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.156006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e75d-dc7b-4e07-969c-f155063bdf1b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.214686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.215490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.215796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.216073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.216757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.218658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.250456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.252347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:02.266306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b199-28c1-47e8-8791-c3360f961c72 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.271282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.272166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.272478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.273468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] PATH_INFO: `/v3/users/6d689e7ca175463ab0c319260ba49d0d` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.273948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d689e7ca175463ab0c319260ba49d0d)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.276029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.306973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1235/2500] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:02 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:02.306973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.316775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079353ca-fdfa-48c8-acf8-28204d283312 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.321367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.322021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.322306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.322585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.323353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.324979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.334777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1236/2501] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:25:02.345919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.357177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b772e-d720-4b07-9309-3a6a6cdd47f8 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.362258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.362971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.363300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.363586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.364597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.366194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.377857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1237/2502] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:25:02.382036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.392131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf692-a034-426f-b638-f2c556ca5bd6 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.396731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d2a01-268b-487f-92ba-c7900ea156cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.397601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2a01-268b-487f-92ba-c7900ea156cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.397884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2a01-268b-487f-92ba-c7900ea156cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.398162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2a01-268b-487f-92ba-c7900ea156cf admin admin] PATH_INFO: `/v3/projects/b642d62e340b4c0ebbad36fa3f6026a8/users/1f3ae7c724b3499bafca1b3161bf2ab7/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.412881 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d2a01-268b-487f-92ba-c7900ea156cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b642d62e340b4c0ebbad36fa3f6026a8, user_id=1f3ae7c724b3499bafca1b3161bf2ab7, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.415672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d2a01-268b-487f-92ba-c7900ea156cf admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.427242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d689e7ca175463ab0c319260ba49d0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:02.427897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d689e7ca175463ab0c319260ba49d0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:02.428966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d689e7ca175463ab0c319260ba49d0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:02.441029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d689e7ca175463ab0c319260ba49d0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:02.447913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d689e7ca175463ab0c319260ba49d0d'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:02.482209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:02.487739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1238/2503] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:02 2022] PUT /identity/v3/projects/b642d62e340b4c0ebbad36fa3f6026a8/users/1f3ae7c724b3499bafca1b3161bf2ab7/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:02.498179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.498467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.498744 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.523880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] MFA Rules not processed for user `1f3ae7c724b3499bafca1b3161bf2ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:02.525044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:02.539122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1266/2504] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:02 2022] DELETE /identity/v3/users/6d689e7ca175463ab0c319260ba49d0d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:02.593647 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1239/2505] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:02.595325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.597134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:02.657461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:02.687207 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e3e5-da4a-4d04-a8bd-aa909055fc24 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.692284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.693043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.693719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.693830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.706002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.706002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.828991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1267/2506] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:02.833088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.863614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:02.865835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:02.910854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8638b-6586-4fa4-a7d0-95fb3854212a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.939016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b693b6-0fd0-4d88-a5d2-b776246bbff5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:02.943602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.944499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.944783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.945062 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] PATH_INFO: `/v3/projects/7651f704e84b4ce8bbd53a6292126bce` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.946265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7651f704e84b4ce8bbd53a6292126bce)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.949235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:02.973417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:02.974097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:02.974388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:02.974670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:02.975410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:02.977390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.053869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7651f704e84b4ce8bbd53a6292126bce', 'request_id': 'req-97f900b1-d9ff-47bd-b447-4ec5f04e414a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:03.089013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1240/2507] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:02 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:03.093571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.103251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bc3d3-d1f5-45af-98e7-dd3f70c7d739 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.124020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:03.146246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7651f704e84b4ce8bbd53a6292126bce', 'request_id': 'req-97f900b1-d9ff-47bd-b447-4ec5f04e414a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:03.153890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7651f704e84b4ce8bbd53a6292126bce', 'request_id': 'req-97f900b1-d9ff-47bd-b447-4ec5f04e414a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:03.160557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.161224 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.161510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.161782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.162511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.164149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.165049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] The token cache is being invalidate because project 7651f704e84b4ce8bbd53a6292126bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:03.165349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:03.165983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97f900b1-d9ff-47bd-b447-4ec5f04e414a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:03.167829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1268/2508] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:02 2022] DELETE /identity/v3/projects/7651f704e84b4ce8bbd53a6292126bce => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:03.172373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3619-f88d-4ede-91fb-1ca5c8b4a4f5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.172666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3619-f88d-4ede-91fb-1ca5c8b4a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.172948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3619-f88d-4ede-91fb-1ca5c8b4a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.174185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1241/2509] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:25:03.178052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.179708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.192204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f7ae3619-f88d-4ede-91fb-1ca5c8b4a4f5 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:03.197357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf75ee-c592-4b9e-a9c0-e5171366662e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.197476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f7ae3619-f88d-4ede-91fb-1ca5c8b4a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.197562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.197914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.198209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.198492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] PATH_INFO: `/v3/projects/2e1a6782d621488584eda2cb5666ac56/users/ab2b2e7d2fe34f538e3c1d369021da6e/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.202652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1269/2510] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:03.209791 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.210084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.210367 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.213846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1a6782d621488584eda2cb5666ac56, user_id=ab2b2e7d2fe34f538e3c1d369021da6e, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.217302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.228813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:03.230132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.238196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1270/2511] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:03.242450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.251684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73688b1-6e87-48de-ae43-b95278c12cee None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.256238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.256867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.257157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.257433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.258150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:03.258458 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.260155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.272197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1271/2512] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:03.276373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.286737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc71551-4fb1-476c-9785-b286ab3fc474 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.291357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.291967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.292249 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.292533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.294939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.295157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.321321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1242/2513] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:03 2022] PUT /identity/v3/projects/2e1a6782d621488584eda2cb5666ac56/users/ab2b2e7d2fe34f538e3c1d369021da6e/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:03.325682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.385329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1272/2514] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:03.385498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb3897-d790-4e27-ad62-0dce7ea7b96f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.386310 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.395606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:03.443929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.444608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.444901 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.445185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.445913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.447592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.451823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3dd7-882b-4e41-983c-4f8ab9800188 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.457186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.457852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.457944 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1243/2515] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:25:03.458216 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.458504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.459303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.461339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.461996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.471769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d37a39-0963-4bca-9b72-2e48ee09d440 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.476391 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b39a6-4756-4ec0-9e32-218cc28207fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.477275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b39a6-4756-4ec0-9e32-218cc28207fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.477549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b39a6-4756-4ec0-9e32-218cc28207fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.477832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b39a6-4756-4ec0-9e32-218cc28207fe admin admin] PATH_INFO: `/v3/projects/2e1a6782d621488584eda2cb5666ac56/users/ab2b2e7d2fe34f538e3c1d369021da6e/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.479852 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b39a6-4756-4ec0-9e32-218cc28207fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1a6782d621488584eda2cb5666ac56, user_id=ab2b2e7d2fe34f538e3c1d369021da6e, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.482542 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b39a6-4756-4ec0-9e32-218cc28207fe admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.492913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1244/2516] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:03 2022] PUT /identity/v3/projects/2e1a6782d621488584eda2cb5666ac56/users/ab2b2e7d2fe34f538e3c1d369021da6e/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:03.504435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.504735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.505021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.531816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] MFA Rules not processed for user `ab2b2e7d2fe34f538e3c1d369021da6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:03.533068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.545713 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:03.557815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1273/2517] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:03.562274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.573198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af055a0-1c9b-4a76-9528-79baeb058ea2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.603545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1245/2518] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:03.614574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.615927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.631890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.632559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.632842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.633125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.633855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.635664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.648874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1274/2519] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:25:03.650283 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.660159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470883a4-459e-4bcb-8df2-108e214b40bb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.665047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.665690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.665968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.666250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.666968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.668600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.672053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50346b-1e2e-4a08-9ffe-4bbd3e0ab2b5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.676855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.677509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.677805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.678086 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.678938 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1275/2520] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:25:03.682987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.683124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.693408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76ff5-1b14-4df1-b37c-bc6c4a61afa1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.698672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.699624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.700552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.700762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] PATH_INFO: `/v3/projects/b4ae082074de4005b46ee0ee61102c7e/users/c79a87a7e39f478e80c6aed5100e40a8/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.717290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ae082074de4005b46ee0ee61102c7e, user_id=c79a87a7e39f478e80c6aed5100e40a8, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.720119 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.750364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.751828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88d89e-8831-464d-bc7e-c59bec9c4932 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:03.760979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1246/2521] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:25:03.782094 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1276/2522] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:03 2022] PUT /identity/v3/projects/b4ae082074de4005b46ee0ee61102c7e/users/c79a87a7e39f478e80c6aed5100e40a8/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:03.795385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702450be-542e-439b-a536-322293232df4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.795677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702450be-542e-439b-a536-322293232df4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.795958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702450be-542e-439b-a536-322293232df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.826060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-702450be-542e-439b-a536-322293232df4 None None] MFA Rules not processed for user `c79a87a7e39f478e80c6aed5100e40a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:03.827478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-702450be-542e-439b-a536-322293232df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:03.890352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:03.899460 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1247/2523] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:03.904079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:03.961810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:03.965564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf620-b959-47b7-a1a5-ea56e385bfb2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:03.970506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:03.971474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:03.971670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:03.972010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:03.972839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:03.974929 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.146281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1277/2524] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:03 2022] POST /identity/v3/projects => generated 405 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:04.150248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702450be-542e-439b-a536-322293232df4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:04.162031 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702450be-542e-439b-a536-322293232df4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:04.224888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:04.225563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.225849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.226120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.226824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:04.228855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.349855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1248/2525] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:04 2022] POST /identity/v3/users => generated 309 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:04.354001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:04.364892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8fac0-d55d-4a1a-853a-9c56ba4032e9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:04.369529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:04.370211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.370496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.370775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.371815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:04.373438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.384746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1278/2526] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:04.389041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:04.401510 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d877-7425-4e28-b764-46dbc931888f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:04.406572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:04.407484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.407776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.408054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] PATH_INFO: `/v3/projects/4c65a8e829034384b29ba19b2eafbf87/users/b2e3fb51155f44ca8d0cf25cf2b3de80/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.425485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c65a8e829034384b29ba19b2eafbf87, user_id=b2e3fb51155f44ca8d0cf25cf2b3de80, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:04.428210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.529706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1249/2527] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:04 2022] PUT /identity/v3/projects/4c65a8e829034384b29ba19b2eafbf87/users/b2e3fb51155f44ca8d0cf25cf2b3de80/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:04.537121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:04.548703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967b5e3-c5d4-42d8-8049-0a624be4d965 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:04.612940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091edbc8-579f-4fa1-b6ac-9549e4f3440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:04.613931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091edbc8-579f-4fa1-b6ac-9549e4f3440f admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.613931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091edbc8-579f-4fa1-b6ac-9549e4f3440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.618359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091edbc8-579f-4fa1-b6ac-9549e4f3440f admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.618359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091edbc8-579f-4fa1-b6ac-9549e4f3440f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:04.618359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091edbc8-579f-4fa1-b6ac-9549e4f3440f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.626875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1279/2528] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:04.630922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:04.641810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83aa0-fc9f-49b5-adec-a42c031d8689 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:04.647681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:04.648585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.648869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.649143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] PATH_INFO: `/v3/projects/4c65a8e829034384b29ba19b2eafbf87/users/b2e3fb51155f44ca8d0cf25cf2b3de80/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.651297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c65a8e829034384b29ba19b2eafbf87, user_id=b2e3fb51155f44ca8d0cf25cf2b3de80, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:04.654556 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.665525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1250/2529] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:04 2022] PUT /identity/v3/projects/4c65a8e829034384b29ba19b2eafbf87/users/b2e3fb51155f44ca8d0cf25cf2b3de80/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:04.677364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.677733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.678147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.705333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] MFA Rules not processed for user `b2e3fb51155f44ca8d0cf25cf2b3de80`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:04.706544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:04.782212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1280/2530] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:04.811043 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:04.859805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a637-6e56-4356-b53a-c61f5849fd08 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:04.863444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f7a15-3659-4766-b6e0-81a5bbeebb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:04.864087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f7a15-3659-4766-b6e0-81a5bbeebb66 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:04.864368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f7a15-3659-4766-b6e0-81a5bbeebb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:04.864643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f7a15-3659-4766-b6e0-81a5bbeebb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:04.874331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f7a15-3659-4766-b6e0-81a5bbeebb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:04.875777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f7a15-3659-4766-b6e0-81a5bbeebb66 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:04.885208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1251/2531] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:05.144706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:05.197279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:05.208673 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d64146-9dd3-4dc1-a2a6-03670e37b3f4 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:05.213313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:05.214220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:05.214480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:05.214758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] PATH_INFO: `/v3/users/c79a87a7e39f478e80c6aed5100e40a8` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:05.216010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79a87a7e39f478e80c6aed5100e40a8)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:05.218029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:05.433609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79a87a7e39f478e80c6aed5100e40a8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:05.434331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79a87a7e39f478e80c6aed5100e40a8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:05.435517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79a87a7e39f478e80c6aed5100e40a8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:05.447434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79a87a7e39f478e80c6aed5100e40a8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:05.456353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79a87a7e39f478e80c6aed5100e40a8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:05.569388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1281/2532] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:05 2022] DELETE /identity/v3/users/c79a87a7e39f478e80c6aed5100e40a8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:05.573859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:05.574316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:05.574418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:05.592182 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:05.593376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:05.642008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:05.656742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1252/2533] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:05.666827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:05.668245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:05.727630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb78b4f-c8d9-4d5e-b3fa-3b0c429990b9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:05.731058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:05.732295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:05.732580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:05.732852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:05.741901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:05.743543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:05.753124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1282/2534] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:06.216448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:06.217877 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:06.229609 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0baea-aa47-445a-947e-0735acc12c55 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:06.237924 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:06.239765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:06.240051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:06.240662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] PATH_INFO: `/v3/projects/b4ae082074de4005b46ee0ee61102c7e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:06.242278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ae082074de4005b46ee0ee61102c7e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:06.244489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:06.352058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ae082074de4005b46ee0ee61102c7e', 'request_id': 'req-e90e7636-2506-4272-81da-0e333df710fd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.357459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ae082074de4005b46ee0ee61102c7e', 'request_id': 'req-e90e7636-2506-4272-81da-0e333df710fd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.363502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ae082074de4005b46ee0ee61102c7e', 'request_id': 'req-e90e7636-2506-4272-81da-0e333df710fd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.413678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] The token cache is being invalidate because project b4ae082074de4005b46ee0ee61102c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:06.413963 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.414618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.416212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1253/2535] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:06 2022] DELETE /identity/v3/projects/b4ae082074de4005b46ee0ee61102c7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:06.420206 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:06.429768 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28639e5-eeef-492d-aa2a-fc0d63d81965 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:06.510892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:06.511792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:06.512078 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:06.512353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] PATH_INFO: `/v3/users/b2e3fb51155f44ca8d0cf25cf2b3de80` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:06.513536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e3fb51155f44ca8d0cf25cf2b3de80)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:06.515540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:06.531700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:06.746031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e3fb51155f44ca8d0cf25cf2b3de80'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.746640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e3fb51155f44ca8d0cf25cf2b3de80'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.747359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e3fb51155f44ca8d0cf25cf2b3de80'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.759332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e3fb51155f44ca8d0cf25cf2b3de80'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.767600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-734d0ec7-1556-455e-908b-8c0453415935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e3fb51155f44ca8d0cf25cf2b3de80'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:06.855048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1283/2536] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:06 2022] DELETE /identity/v3/users/b2e3fb51155f44ca8d0cf25cf2b3de80 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:07.315526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:07.316949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:07.330129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e7636-2506-4272-81da-0e333df710fd admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:07.386487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:07.387400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:07.387683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:07.387960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] PATH_INFO: `/v3/projects/4c65a8e829034384b29ba19b2eafbf87` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:07.389137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c65a8e829034384b29ba19b2eafbf87)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:07.391021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:07.496780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c65a8e829034384b29ba19b2eafbf87', 'request_id': 'req-5ba5ea97-4275-4dd0-a61f-2124116eb15d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:07.502317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c65a8e829034384b29ba19b2eafbf87', 'request_id': 'req-5ba5ea97-4275-4dd0-a61f-2124116eb15d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:07.508573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c65a8e829034384b29ba19b2eafbf87', 'request_id': 'req-5ba5ea97-4275-4dd0-a61f-2124116eb15d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:07.568320 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] The token cache is being invalidate because project 4c65a8e829034384b29ba19b2eafbf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:07.568528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:07.569136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-5ba5ea97-4275-4dd0-a61f-2124116eb15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:07.570697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1254/2537] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:07 2022] DELETE /identity/v3/projects/4c65a8e829034384b29ba19b2eafbf87 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:07.576099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:07.576382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:07.576654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:07.595155 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:07.596340 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:07.653659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1284/2538] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:07.661519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:07.661808 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:07.662089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:07.669199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:07.679786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:07.680966 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:07.688698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1255/2539] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:07.692846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:07.703122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cab5c-f192-4bab-a637-d57c7a480af6 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:07.707696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:07.709286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:07.709580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:07.709860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:07.710584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:07.710893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:07.712543 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:07.724616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1285/2540] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:07.728865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:07.738569 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0830022-e857-4858-a7be-ac37da98c683 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:07.743205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:07.743849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:07.744136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:07.744414 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:07.745102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:07.747220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:07.855089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1256/2541] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:07 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:07.859256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:07.869110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ea08-1c82-4062-b6be-3af334391eda admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:07.923928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:07.924608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:07.924890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:07.925166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:07.925847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:07.927800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.002159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1286/2542] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:07 2022] POST /identity/v3/users => generated 282 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:08.006287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.017269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca9039-aab0-480e-9f8b-930c50944c1e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.021838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.025261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.025261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.025261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.025261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.025562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.035515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1257/2543] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:08.039267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.048943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbb998-1fda-4017-bff3-aa9db52e4009 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.053443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9799ae-dbc3-4529-8d7b-7ed8fd7ace5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.054086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9799ae-dbc3-4529-8d7b-7ed8fd7ace5b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.054369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9799ae-dbc3-4529-8d7b-7ed8fd7ace5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.054645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9799ae-dbc3-4529-8d7b-7ed8fd7ace5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.055408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9799ae-dbc3-4529-8d7b-7ed8fd7ace5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.057030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9799ae-dbc3-4529-8d7b-7ed8fd7ace5b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.062635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:08.068247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1287/2544] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:08.077719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.087839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b57be-0205-4af4-9412-2bc307e2603a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.092492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.093372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.093659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.093939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] PATH_INFO: `/v3/projects/872728a8af7f4265b234dead5fd8a14a/users/3df10ff12f134ab797e3b1ff22d83c6c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.109399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872728a8af7f4265b234dead5fd8a14a, user_id=3df10ff12f134ab797e3b1ff22d83c6c, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.112046 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.181176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1258/2545] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:08 2022] PUT /identity/v3/projects/872728a8af7f4265b234dead5fd8a14a/users/3df10ff12f134ab797e3b1ff22d83c6c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:08.192007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.192378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.192749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.221978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] MFA Rules not processed for user `3df10ff12f134ab797e3b1ff22d83c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:08.223197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:08.289650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1288/2546] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:08.294616 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.356814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ad60-8ee2-4846-ab8a-f754202b6064 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.361575 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.362183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.362472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.362754 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.363479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.365383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.462344 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1259/2547] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:08 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:08.466408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.477059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4be37-a70e-42cf-b042-4d2d64bc902c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.531302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.531961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.532242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.532516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.533190 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.535386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.609079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1289/2548] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:08 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:08.613128 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.623916 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3628e-ba37-46fc-bbdd-52498e840b11 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.628567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.629223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.629507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.629782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.630541 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.632164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.642614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1260/2549] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:08.646703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.657232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2468c-fc49-44af-ab15-15076f765ed9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.662080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.662970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.663285 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.663567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] PATH_INFO: `/v3/projects/8685f8e9c4c64d61abaf06b2e0690ff6/users/20ab732ac70f4497aade1a40a35890dd/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.679642 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8685f8e9c4c64d61abaf06b2e0690ff6, user_id=20ab732ac70f4497aade1a40a35890dd, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.682311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.752734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1290/2550] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:08 2022] PUT /identity/v3/projects/8685f8e9c4c64d61abaf06b2e0690ff6/users/20ab732ac70f4497aade1a40a35890dd/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:08.756903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.766923 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97037-cab6-48a2-81f9-547bc3d32c96 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.824264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e72ca-432f-4767-b749-2ff316ae5c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.824945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e72ca-432f-4767-b749-2ff316ae5c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.825229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e72ca-432f-4767-b749-2ff316ae5c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.825506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e72ca-432f-4767-b749-2ff316ae5c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.826220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e72ca-432f-4767-b749-2ff316ae5c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.827834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e72ca-432f-4767-b749-2ff316ae5c87 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.837225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1261/2551] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:08.841997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.852402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9336be-db12-4c50-9f55-1c54ef3aaae0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:08.857594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:08.858471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.858755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.859030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] PATH_INFO: `/v3/projects/8685f8e9c4c64d61abaf06b2e0690ff6/users/20ab732ac70f4497aade1a40a35890dd/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.860999 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8685f8e9c4c64d61abaf06b2e0690ff6, user_id=20ab732ac70f4497aade1a40a35890dd, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:08.863741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:08.873949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1291/2552] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:08 2022] PUT /identity/v3/projects/8685f8e9c4c64d61abaf06b2e0690ff6/users/20ab732ac70f4497aade1a40a35890dd/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:08.885231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:08.886983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:08.886983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:08.905124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:08.912300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] MFA Rules not processed for user `20ab732ac70f4497aade1a40a35890dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:08.913488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:08.980373 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1262/2553] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:08.993947 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:08.995686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:09.040845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:09.051990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbdaa1-87fd-481e-bebd-b1870a468d94 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:09.055656 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:09.056292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:09.056573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:09.056849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:09.065579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:09.067001 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:09.076965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1292/2554] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:09.290752 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:09.300409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cce34-2ea2-437d-8d1b-1c86816c35ab None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:09.303922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:09.304607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:09.304931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:09.305206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:09.360628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:09.362042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:09.371310 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1263/2555] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:12.312714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:12.314204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:12.326211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af3485-84c1-4411-adc3-fa23ba92d76e service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:12.329795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:12.330433 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:12.330717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:12.330993 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:12.332896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:12.398057 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:12.399460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f230c8-8399-4d2f-bee8-a26daf9fab7e service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:12.409303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1293/2556] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:19.367596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=57 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:22.404681 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=37 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:42.720324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:42.783162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0df0d5-bbd1-440b-a74a-abf5c01de385 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:42.788565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:42.789432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:42.789800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:42.790084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] PATH_INFO: `/v3/users/3df10ff12f134ab797e3b1ff22d83c6c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:42.791299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df10ff12f134ab797e3b1ff22d83c6c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:42.793210 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:42.958623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df10ff12f134ab797e3b1ff22d83c6c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.030002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df10ff12f134ab797e3b1ff22d83c6c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.030602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df10ff12f134ab797e3b1ff22d83c6c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.043446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df10ff12f134ab797e3b1ff22d83c6c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.050251 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df10ff12f134ab797e3b1ff22d83c6c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.056768 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1264/2557] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:42 2022] DELETE /identity/v3/users/3df10ff12f134ab797e3b1ff22d83c6c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:43.061449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:43.061921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:43.062020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:43.081555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:43.082824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:43.146651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1294/2558] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:43.156350 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:43.157776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:43.215848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b6f2-92f4-4bcc-947c-63e84a107548 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:43.220377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:43.220377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:43.220626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:43.220866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:43.238273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:43.239843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:43.252717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1265/2559] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:43.725497 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:43.727136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:43.742123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17639fb-bfda-412a-a228-ede4cfe7ae5f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:43.747144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:43.748012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:43.748297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:43.748575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] PATH_INFO: `/v3/projects/872728a8af7f4265b234dead5fd8a14a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:43.749755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=872728a8af7f4265b234dead5fd8a14a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:43.751727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:43.858948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872728a8af7f4265b234dead5fd8a14a', 'request_id': 'req-550e8e02-aa22-4839-a474-36b114bb32cd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.938328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872728a8af7f4265b234dead5fd8a14a', 'request_id': 'req-550e8e02-aa22-4839-a474-36b114bb32cd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.945480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872728a8af7f4265b234dead5fd8a14a', 'request_id': 'req-550e8e02-aa22-4839-a474-36b114bb32cd'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.956401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] The token cache is being invalidate because project 872728a8af7f4265b234dead5fd8a14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:43.956687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.957384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:43.959368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1295/2560] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:43 2022] DELETE /identity/v3/projects/872728a8af7f4265b234dead5fd8a14a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:43.963462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:43.973912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa4b61-89f1-4e33-b731-04a80b6649dd service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:43.996499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.037759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.038668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.038955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.039278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] PATH_INFO: `/v3/users/20ab732ac70f4497aade1a40a35890dd` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.040467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ab732ac70f4497aade1a40a35890dd)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:44.042410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:44.214964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ab732ac70f4497aade1a40a35890dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.293066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ab732ac70f4497aade1a40a35890dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.293844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ab732ac70f4497aade1a40a35890dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.308694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ab732ac70f4497aade1a40a35890dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.315692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-12f184b7-b9fb-44d8-be39-1b318ea871d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ab732ac70f4497aade1a40a35890dd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.321538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1266/2561] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:43 2022] DELETE /identity/v3/users/20ab732ac70f4497aade1a40a35890dd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:44.712507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:44.714463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:44.728324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e8e02-aa22-4839-a474-36b114bb32cd admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:44.784406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:44.786036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.786319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.786596 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] PATH_INFO: `/v3/projects/8685f8e9c4c64d61abaf06b2e0690ff6` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.787795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8685f8e9c4c64d61abaf06b2e0690ff6)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:44.789711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:44.861025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:44.876892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8685f8e9c4c64d61abaf06b2e0690ff6', 'request_id': 'req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.927912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8685f8e9c4c64d61abaf06b2e0690ff6', 'request_id': 'req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.934412 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8685f8e9c4c64d61abaf06b2e0690ff6', 'request_id': 'req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.945165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] The token cache is being invalidate because project 8685f8e9c4c64d61abaf06b2e0690ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:44.945457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.946103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-e56a0077-7d3a-4c9b-bd77-acdd93c4ab84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:44.947746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1296/2562] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:44 2022] DELETE /identity/v3/projects/8685f8e9c4c64d61abaf06b2e0690ff6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:44.952602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:44.952904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:44.953191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:44.972130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:44.974022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:45.034179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1267/2563] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:45.042888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.043215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.043611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.065137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:45.066344 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:45.074366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1297/2564] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:45.078665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.089006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646755d-7206-4aae-a340-14be064dcdb3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.093467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.094118 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.094407 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.094685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.095462 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:45.095771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.097389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.109513 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1268/2565] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:25:45.113969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.123303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf39d4-dbc6-480d-9c63-3d558cba2bd3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.128007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.128651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.128932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.129208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.129890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.131862 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.221172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1298/2566] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:45.225441 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.235596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14476-2403-494e-86a6-fe64048d41e4 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.262160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:45.293714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.294382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.294664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.294938 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.295649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.297540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.391588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1269/2567] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:45.396402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.406743 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38fa1b-b86d-41ce-ac53-e060dee2b1c6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.411759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.412406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.412690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.412965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.413695 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.415322 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.425437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1299/2568] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:45.429506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.439311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828688-5da0-44c5-9294-f8e7119a6bb0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.445144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338902-597e-4950-9bb4-ec81144056f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.445795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338902-597e-4950-9bb4-ec81144056f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.446100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338902-597e-4950-9bb4-ec81144056f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.446364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338902-597e-4950-9bb4-ec81144056f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.447165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27338902-597e-4950-9bb4-ec81144056f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.449223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27338902-597e-4950-9bb4-ec81144056f0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.460443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1270/2569] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:45.465911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.475892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa17c1-175e-4da6-9ec9-5567dc7d6cd3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.480574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.481467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.481757 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.482036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] PATH_INFO: `/v3/projects/339aac5f56fc412e881e33376d865f1b/users/7acaaf0ca3324c1e9fa0e2e959b0f3f8/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.496462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339aac5f56fc412e881e33376d865f1b, user_id=7acaaf0ca3324c1e9fa0e2e959b0f3f8, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.499196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.596021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1300/2570] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:45 2022] PUT /identity/v3/projects/339aac5f56fc412e881e33376d865f1b/users/7acaaf0ca3324c1e9fa0e2e959b0f3f8/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:45.607282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.607583 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.608260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.635873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] MFA Rules not processed for user `7acaaf0ca3324c1e9fa0e2e959b0f3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:45.637091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:45.700222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1271/2571] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:45.704578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.767905 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b9339-f989-4cdc-82ee-54698fec4528 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.772727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.773502 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.773794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.774076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.774777 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.776804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:45.877812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1301/2572] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:45.882696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:45.893419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ee413-1691-4eae-bdc9-462c60c83711 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:45.949587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:45.950293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:45.950577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:45.950855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:45.951585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:45.953499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.038178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1272/2573] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:45 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:46.043837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.055235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019b4ad-cc87-430b-b9d2-aa3704394e5c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.059517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.060174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.060460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.060738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.061463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.063063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.073909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1302/2574] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:46.078189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.088176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6f89-28f7-4d17-a560-7981541233df admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.095377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.096591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.096591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.097011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] PATH_INFO: `/v3/projects/0ec16942439d415b8b5c9025da23b663/users/1cfd0faa228c4c32b08fbf87deb14f74/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.112322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec16942439d415b8b5c9025da23b663, user_id=1cfd0faa228c4c32b08fbf87deb14f74, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.115651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.213733 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1273/2575] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:46 2022] PUT /identity/v3/projects/0ec16942439d415b8b5c9025da23b663/users/1cfd0faa228c4c32b08fbf87deb14f74/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:46.217602 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.228137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff43fc-8ca6-4f0c-8d36-4c76ef8f3e50 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.248946 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.286526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af926d0-e5c7-4212-8ebf-87e3b02a6303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.287236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af926d0-e5c7-4212-8ebf-87e3b02a6303 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.287518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af926d0-e5c7-4212-8ebf-87e3b02a6303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.287788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af926d0-e5c7-4212-8ebf-87e3b02a6303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.288504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af926d0-e5c7-4212-8ebf-87e3b02a6303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.290095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af926d0-e5c7-4212-8ebf-87e3b02a6303 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.299621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1303/2576] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:46.304352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.309774 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:46.314941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932175-8532-44a0-a7bf-b8ca4e50eab6 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.319688 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.320562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.320841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.321159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] PATH_INFO: `/v3/projects/0ec16942439d415b8b5c9025da23b663/users/1cfd0faa228c4c32b08fbf87deb14f74/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.323143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec16942439d415b8b5c9025da23b663, user_id=1cfd0faa228c4c32b08fbf87deb14f74, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.325788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.336602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1274/2577] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:46 2022] PUT /identity/v3/projects/0ec16942439d415b8b5c9025da23b663/users/1cfd0faa228c4c32b08fbf87deb14f74/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:46.346804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.347124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.347414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.373805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] MFA Rules not processed for user `1cfd0faa228c4c32b08fbf87deb14f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:46.375012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:46.441735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1304/2578] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:46.452964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.454641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:46.511004 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e715c8-c7b4-4d7b-a510-ca24fb24981f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.514595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.515267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.515552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.515836 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.525253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.526680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.537306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1275/2579] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:46.712287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:46.713730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:46.725830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca97f-ac83-4c87-9083-c29208c2a6fe None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:46.729362 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b00e2-c46f-4d84-a179-95433830c9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:46.730033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b00e2-c46f-4d84-a179-95433830c9bc service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:46.730314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b00e2-c46f-4d84-a179-95433830c9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:46.730592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b00e2-c46f-4d84-a179-95433830c9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:46.786726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b00e2-c46f-4d84-a179-95433830c9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:46.788140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b00e2-c46f-4d84-a179-95433830c9bc service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:46.797272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1305/2580] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:51.351749 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.413438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12935193-633a-4cb1-84e5-b369aba52588 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.418410 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.418857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.419170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.424034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] PATH_INFO: `/v3/users/7acaaf0ca3324c1e9fa0e2e959b0f3f8` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.424034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acaaf0ca3324c1e9fa0e2e959b0f3f8)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:51.424034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:51.615244 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acaaf0ca3324c1e9fa0e2e959b0f3f8'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:51.665895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acaaf0ca3324c1e9fa0e2e959b0f3f8'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:51.666607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acaaf0ca3324c1e9fa0e2e959b0f3f8'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:51.680773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acaaf0ca3324c1e9fa0e2e959b0f3f8'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:51.687691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acaaf0ca3324c1e9fa0e2e959b0f3f8'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:51.694394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1276/2581] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:51 2022] DELETE /identity/v3/users/7acaaf0ca3324c1e9fa0e2e959b0f3f8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:51.699063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.699567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.705465 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.719453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:51.720662 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:51.771208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.794090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1306/2582] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:51.803678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:51.805801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:51.821469 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:51.867116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14860d7e-9699-4b03-94c8-f52718168353 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:51.870832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:51.871522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:51.871811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:51.872093 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:51.881698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:51.883157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:51.892525 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1277/2583] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:52.273349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.274778 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:52.288136 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d145a4-8cec-4f96-b08b-2b7dc17373f3 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.295085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.296172 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.296553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.296828 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] PATH_INFO: `/v3/projects/339aac5f56fc412e881e33376d865f1b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.298197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] RBAC: Authorizing `identity:delete_project(project_id=339aac5f56fc412e881e33376d865f1b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.300447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.417439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339aac5f56fc412e881e33376d865f1b', 'request_id': 'req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.465811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339aac5f56fc412e881e33376d865f1b', 'request_id': 'req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.472771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339aac5f56fc412e881e33376d865f1b', 'request_id': 'req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.484065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] The token cache is being invalidate because project 339aac5f56fc412e881e33376d865f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:52.484350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.484987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.486526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1307/2584] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:52 2022] DELETE /identity/v3/projects/339aac5f56fc412e881e33376d865f1b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:52.490760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:52.501143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f165f-d1e6-4a5b-8709-0a2e41522dde service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:52.557322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:52.558214 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:52.558478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:52.558753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] PATH_INFO: `/v3/users/1cfd0faa228c4c32b08fbf87deb14f74` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:52.559971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfd0faa228c4c32b08fbf87deb14f74)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:52.562014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:52.803876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfd0faa228c4c32b08fbf87deb14f74'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.893002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfd0faa228c4c32b08fbf87deb14f74'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.893765 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfd0faa228c4c32b08fbf87deb14f74'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.908745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfd0faa228c4c32b08fbf87deb14f74'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.915835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0dca223b-8385-48e1-8a1f-d1cfbed515f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfd0faa228c4c32b08fbf87deb14f74'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:52.921750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1278/2585] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:52 2022] DELETE /identity/v3/users/1cfd0faa228c4c32b08fbf87deb14f74 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:53.346434 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.348124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:53.362414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2922-9b29-4f4a-9eee-1aa10ebd892e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.432787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.433776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.434189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.434469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] PATH_INFO: `/v3/projects/0ec16942439d415b8b5c9025da23b663` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.435968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec16942439d415b8b5c9025da23b663)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:53.437923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:53.539825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec16942439d415b8b5c9025da23b663', 'request_id': 'req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:53.625773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec16942439d415b8b5c9025da23b663', 'request_id': 'req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:53.633480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec16942439d415b8b5c9025da23b663', 'request_id': 'req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:53.642487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:53.647202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] The token cache is being invalidate because project 0ec16942439d415b8b5c9025da23b663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:53.647491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:53.648142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-0cef8a17-2740-4cbe-a456-6e6c59fd9c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:53.649860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1308/2586] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:53 2022] DELETE /identity/v3/projects/0ec16942439d415b8b5c9025da23b663 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:53.655638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.656907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.656907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.677137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:53.678357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:53.707426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:53.752534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1279/2587] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:53.760166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.760501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.760779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.778776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:53.780071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:53.790886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1309/2588] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:53.795266 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.805662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb96de5-1e9f-4d33-b944-86c13f8fb3f9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.810288 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.810943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.811258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.811535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.812265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:53.812573 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:53.814160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:53.825953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1280/2589] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:53.837900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.847427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770b46-45b6-4c79-a5be-ea7958d2a411 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:53.852660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:53.853318 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:53.853608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:53.853885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:53.854577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:53.856549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:53.969461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1310/2590] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:53.974022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:53.983920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8ca2b-e430-4080-b259-745b36069d37 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.054229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.054927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.055258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.055258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.056239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.058174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.131913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1281/2591] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:53 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:54.133198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.143716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27070d7d-0f2a-427d-9035-8d56bbaf7b12 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.149179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.149857 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.150141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.150453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.151287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.152927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.164692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1311/2592] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:54.168730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.179845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629847-8dcd-43a6-ad52-218f7aaa9a07 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.184549 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.185205 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.185518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.185798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.186529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.188161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.198268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1282/2593] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:54.202578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.214011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2b59-b006-4a0e-b73c-ee5965c01baf admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.218712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ced7c-1ac8-46da-8319-f3ef1ecdb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.219694 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ced7c-1ac8-46da-8319-f3ef1ecdb840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.219936 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ced7c-1ac8-46da-8319-f3ef1ecdb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.220219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ced7c-1ac8-46da-8319-f3ef1ecdb840 admin admin] PATH_INFO: `/v3/projects/eae11d8a342e4f7e91b1c6f22b8d6e43/users/5af942feae564d9ba3bf0a8155d8ba68/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.236068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ced7c-1ac8-46da-8319-f3ef1ecdb840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae11d8a342e4f7e91b1c6f22b8d6e43, user_id=5af942feae564d9ba3bf0a8155d8ba68, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.238803 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ced7c-1ac8-46da-8319-f3ef1ecdb840 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.280974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.282701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:54.296371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad58e9-98a4-4a40-adfd-53eadd3b6b7e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.300976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.301872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.302158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.302448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] PATH_INFO: `/v3/users/1f3ae7c724b3499bafca1b3161bf2ab7` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.303756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3ae7c724b3499bafca1b3161bf2ab7)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.305712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.317278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1312/2594] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:54 2022] PUT /identity/v3/projects/eae11d8a342e4f7e91b1c6f22b8d6e43/users/5af942feae564d9ba3bf0a8155d8ba68/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:54.328951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.329575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.329575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.357927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] MFA Rules not processed for user `5af942feae564d9ba3bf0a8155d8ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:54.359164 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:54.429220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1313/2595] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:54.433494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.498450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3ae7c724b3499bafca1b3161bf2ab7'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:54.504023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992929b3-2d9e-4596-9ceb-481d734d5b77 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.508976 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.509815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.510182 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.510468 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.511196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.513147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.574348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3ae7c724b3499bafca1b3161bf2ab7'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:54.575196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3ae7c724b3499bafca1b3161bf2ab7'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:54.588177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3ae7c724b3499bafca1b3161bf2ab7'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:54.594899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cd42b2ee-e023-4e6f-808c-9b9498e9fe81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3ae7c724b3499bafca1b3161bf2ab7'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:54.600870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1283/2596] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:54 2022] DELETE /identity/v3/users/1f3ae7c724b3499bafca1b3161bf2ab7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:54.605463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.605762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.606027 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.616583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1314/2597] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:54 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:54.620944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.624518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:54.629693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:54.631601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:54.636842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:54.641703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:54.698646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c543-4dc2-4de1-ba4f-2d04521d4b28 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.703419 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.704148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1284/2598] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:54.704604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.704604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.704769 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.705372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.707431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.714880 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.717077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:54.774679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf75c-ab0e-4636-8436-e732a03ddab6 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.778531 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.779246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.784102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.784102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.789756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.791233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.800588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1285/2599] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:25:54.808992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1315/2600] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:54 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:54.817439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.826040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a190-d603-4afb-bf53-ae415859c4ce service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.830789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.831490 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.831787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.832057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.832786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.834987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.845249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1286/2601] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:54.849629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:54.864616 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf191a7-1d41-4402-9c4a-29350917cac9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:54.874336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:54.874336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:54.874336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:54.874336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] PATH_INFO: `/v3/projects/f4ffbda9791f444ca6a191efd4e13fd6/users/522b3ac532cb4683ba4a8501aec7902e/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:54.886727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ffbda9791f444ca6a191efd4e13fd6, user_id=522b3ac532cb4683ba4a8501aec7902e, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:54.889487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:54.997459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1316/2602] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:54 2022] PUT /identity/v3/projects/f4ffbda9791f444ca6a191efd4e13fd6/users/522b3ac532cb4683ba4a8501aec7902e/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:55.001680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.012530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e342-1670-4c88-8bb8-0a5b23fda250 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.083800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c43bb9-1d8e-4ada-9cc5-e961a3cd4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.084498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43bb9-1d8e-4ada-9cc5-e961a3cd4e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.084782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43bb9-1d8e-4ada-9cc5-e961a3cd4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.085062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43bb9-1d8e-4ada-9cc5-e961a3cd4e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.085912 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c43bb9-1d8e-4ada-9cc5-e961a3cd4e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.088183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c43bb9-1d8e-4ada-9cc5-e961a3cd4e2c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.099536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1287/2603] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:55.103361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.113852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82fb0f-6321-4463-9017-66f7081fdbd5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.119076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.120117 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.120280 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.120574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] PATH_INFO: `/v3/projects/f4ffbda9791f444ca6a191efd4e13fd6/users/522b3ac532cb4683ba4a8501aec7902e/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.125446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ffbda9791f444ca6a191efd4e13fd6, user_id=522b3ac532cb4683ba4a8501aec7902e, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.128175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.139567 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1317/2604] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:55 2022] PUT /identity/v3/projects/f4ffbda9791f444ca6a191efd4e13fd6/users/522b3ac532cb4683ba4a8501aec7902e/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:55.152144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.152432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.152712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.181983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] MFA Rules not processed for user `522b3ac532cb4683ba4a8501aec7902e`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:55.183256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:55.224433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=100 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:55.269253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1288/2605] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:55.272700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.276145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:55.280714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.282697 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:55.352820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db4c2f-da4d-41e8-8197-74c5911adc8d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.355781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff73b0-7d8a-489d-b793-df88cb8d05aa None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.357719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.358610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.359178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.359178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] PATH_INFO: `/v3/projects/b642d62e340b4c0ebbad36fa3f6026a8` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.359449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.360097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.360384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.360472 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b642d62e340b4c0ebbad36fa3f6026a8)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.360665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.362442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.370813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.372337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.382029 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1289/2606] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:25:55.483530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b642d62e340b4c0ebbad36fa3f6026a8', 'request_id': 'req-090578cf-56d3-4902-895d-8518492b582a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:55.591706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b642d62e340b4c0ebbad36fa3f6026a8', 'request_id': 'req-090578cf-56d3-4902-895d-8518492b582a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:55.601219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b642d62e340b4c0ebbad36fa3f6026a8', 'request_id': 'req-090578cf-56d3-4902-895d-8518492b582a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:55.603683 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:55.612865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] The token cache is being invalidate because project b642d62e340b4c0ebbad36fa3f6026a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:55.613176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:55.613856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:55.616008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1318/2607] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:55 2022] DELETE /identity/v3/projects/b642d62e340b4c0ebbad36fa3f6026a8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:55.620534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:55.632157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cbc57-1d5b-4cf9-898d-6114b8102867 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:55.693537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:55.694497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:55.694779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:55.695055 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] PATH_INFO: `/v3/users/ab2b2e7d2fe34f538e3c1d369021da6e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:55.699290 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2b2e7d2fe34f538e3c1d369021da6e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:55.701519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:55.926824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2b2e7d2fe34f538e3c1d369021da6e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.002888 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2b2e7d2fe34f538e3c1d369021da6e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.003558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2b2e7d2fe34f538e3c1d369021da6e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.015593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:56.016865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2b2e7d2fe34f538e3c1d369021da6e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.024301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e781cdd3-1de9-4d00-9f57-bfc57f3cb045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2b2e7d2fe34f538e3c1d369021da6e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.030164 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1290/2608] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:55 2022] DELETE /identity/v3/users/ab2b2e7d2fe34f538e3c1d369021da6e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:25:56.476345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.477863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:56.498404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090578cf-56d3-4902-895d-8518492b582a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.570218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.571408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.571792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.572180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] PATH_INFO: `/v3/projects/2e1a6782d621488584eda2cb5666ac56` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.575208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1a6782d621488584eda2cb5666ac56)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:56.578749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:56.709937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1a6782d621488584eda2cb5666ac56', 'request_id': 'req-335dd70e-4a53-4923-94de-e9559bfb6122'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.774045 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1a6782d621488584eda2cb5666ac56', 'request_id': 'req-335dd70e-4a53-4923-94de-e9559bfb6122'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.785853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1a6782d621488584eda2cb5666ac56', 'request_id': 'req-335dd70e-4a53-4923-94de-e9559bfb6122'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.797466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] The token cache is being invalidate because project 2e1a6782d621488584eda2cb5666ac56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:56.797755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.798415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-335dd70e-4a53-4923-94de-e9559bfb6122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:56.799984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1319/2609] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:56 2022] DELETE /identity/v3/projects/2e1a6782d621488584eda2cb5666ac56 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:56.805461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.805753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.806062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.825680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:56.827782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:56.891487 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1291/2610] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:56.899493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.899786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.900065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.922992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:56.927253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:56.933453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1320/2611] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:56.937745 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.950602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4de4fd-75c5-4f47-99ce-0536a628eda4 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.956222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.956887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.957171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.957447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:56.958209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:25:56.958512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:56.960248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:56.973751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1292/2612] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:25:56.978516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:56.992405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888e092-dd25-4c32-b011-9e7fc26a49d1 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:56.997880 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:56.998679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:56.998960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:56.999271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.000213 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.002396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.080438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1321/2613] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:56 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:25:57.084724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.095211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9807-3e68-4626-8683-dc48b6040f62 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.155743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.156341 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.156626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.156949 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.157587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.160080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.252020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1293/2614] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:57 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:57.255010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.266178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d90736-e98d-4702-8dd7-191623074801 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.271053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.272262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.272545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.272820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.273571 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.275201 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.290855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1322/2615] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:57.294488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.311476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792904-112a-4a6d-bf9d-7d47c6667b2a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.316367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5272c9d-7ef1-43eb-94cd-ec781d720fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.317295 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5272c9d-7ef1-43eb-94cd-ec781d720fab admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.317651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5272c9d-7ef1-43eb-94cd-ec781d720fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.317999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5272c9d-7ef1-43eb-94cd-ec781d720fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.318983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5272c9d-7ef1-43eb-94cd-ec781d720fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.321333 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5272c9d-7ef1-43eb-94cd-ec781d720fab admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.332856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1294/2616] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:57.337762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.348733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816c4c8-4038-4dbe-9f9a-5ebe6a0f057c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.354104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.354989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.355345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.355625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] PATH_INFO: `/v3/projects/1a938ac4d8b74b5bb75658bee5816a40/users/07ef9d9bc69240bf96b84c19eba264cb/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.369989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a938ac4d8b74b5bb75658bee5816a40, user_id=07ef9d9bc69240bf96b84c19eba264cb, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.372783 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.454051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1323/2617] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:57 2022] PUT /identity/v3/projects/1a938ac4d8b74b5bb75658bee5816a40/users/07ef9d9bc69240bf96b84c19eba264cb/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:57.465848 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.466081 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.466366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.493353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] MFA Rules not processed for user `07ef9d9bc69240bf96b84c19eba264cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:57.494592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:57.544547 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.568219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1295/2618] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:57.579290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.605682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:57.656431 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eba6b0-e54d-4bc2-91f2-0ce139439955 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.662911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.663630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.673660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.673660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.673660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.673660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.757739 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1324/2619] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:25:57 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:57.762039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.773933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7ef7-365b-4598-ac45-0e8b0e28a47f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.837180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.841984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.841984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.841984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.841984 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.844177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.917841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1296/2620] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:25:57 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:25:57.921992 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.933450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c46aa-c4f4-4d44-86ea-77444bce9595 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.938447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.939149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.939448 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.939731 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.940467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.946854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:57.955721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1325/2621] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:57.959898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:57.975322 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46296229-ed9a-4543-ac21-8e96cf6a0ce4 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:57.981934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:57.981934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:57.981934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:57.981934 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] PATH_INFO: `/v3/projects/2bc44b349f9b402cac7b2970ea5a2716/users/e447accac8134ecca70a5abdf16021f6/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:57.997053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc44b349f9b402cac7b2970ea5a2716, user_id=e447accac8134ecca70a5abdf16021f6, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:57.999746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.072403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1297/2622] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:57 2022] PUT /identity/v3/projects/2bc44b349f9b402cac7b2970ea5a2716/users/e447accac8134ecca70a5abdf16021f6/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:58.076284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.086626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018adc6-e794-4953-b6e0-56e86246dd66 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.147327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b21f2-36fd-4390-9cc6-ddf97667878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.148007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b21f2-36fd-4390-9cc6-ddf97667878d admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.148292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b21f2-36fd-4390-9cc6-ddf97667878d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.148595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b21f2-36fd-4390-9cc6-ddf97667878d admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.149305 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b21f2-36fd-4390-9cc6-ddf97667878d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.150914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b21f2-36fd-4390-9cc6-ddf97667878d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.164872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1326/2623] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:25:58.166085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.176971 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8299c84-95af-4862-9310-69698d70f324 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.182282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.183222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.183511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.183792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] PATH_INFO: `/v3/projects/2bc44b349f9b402cac7b2970ea5a2716/users/e447accac8134ecca70a5abdf16021f6/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.185777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc44b349f9b402cac7b2970ea5a2716, user_id=e447accac8134ecca70a5abdf16021f6, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.188464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.199681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1298/2624] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:25:58 2022] PUT /identity/v3/projects/2bc44b349f9b402cac7b2970ea5a2716/users/e447accac8134ecca70a5abdf16021f6/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:58.210587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.211054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.211432 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.242409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.244190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:58.245576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] MFA Rules not processed for user `e447accac8134ecca70a5abdf16021f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:58.246802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:58.319245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db4bfa-398b-4a44-a848-f74eb094b19b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.319501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1327/2625] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:25:58.324150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.324987 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.325277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.325559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] PATH_INFO: `/v3/users/5af942feae564d9ba3bf0a8155d8ba68` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.326835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af942feae564d9ba3bf0a8155d8ba68)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.328786 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.330830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.332299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:58.349437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.398665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7eae9-bfae-4c8e-a9cc-2386b13299eb None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.402383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.403034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.403361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.403641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.413682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.415668 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.426361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1328/2626] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:58.517199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:58.536729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af942feae564d9ba3bf0a8155d8ba68'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:58.562416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.564271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:58.576128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3c22-daea-4a7c-8747-9a290fbc0f85 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.579799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.580447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.580730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.581011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.618484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af942feae564d9ba3bf0a8155d8ba68'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:58.619252 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af942feae564d9ba3bf0a8155d8ba68'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:58.633279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af942feae564d9ba3bf0a8155d8ba68'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:58.640013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a3694274-6130-47cf-b388-14225e67a34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af942feae564d9ba3bf0a8155d8ba68'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:58.642236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.642236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.645911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1299/2627] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:58 2022] DELETE /identity/v3/users/5af942feae564d9ba3bf0a8155d8ba68 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:58.650699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.650993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.651306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.652181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1329/2628] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:25:58.673339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:25:58.674643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:58.744559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1300/2629] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:25:58.761564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:58.763563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:58.829806 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa1f36-1128-4354-a3fe-ed114e36b139 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:58.879874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:58.886147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:58.886147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:58.886147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:58.890235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:58.891705 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:58.901706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1330/2630] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:25:59.330876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.334509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:25:59.357359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5d44-01d7-41f2-9d18-cd25dc423075 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.367229 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.368253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.368636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.369048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] PATH_INFO: `/v3/projects/eae11d8a342e4f7e91b1c6f22b8d6e43` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.370437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae11d8a342e4f7e91b1c6f22b8d6e43)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.372365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.529403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae11d8a342e4f7e91b1c6f22b8d6e43', 'request_id': 'req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.535422 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae11d8a342e4f7e91b1c6f22b8d6e43', 'request_id': 'req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.541568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae11d8a342e4f7e91b1c6f22b8d6e43', 'request_id': 'req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.625236 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] The token cache is being invalidate because project eae11d8a342e4f7e91b1c6f22b8d6e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:25:59.625456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.626052 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.627627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1301/2631] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:25:59 2022] DELETE /identity/v3/projects/eae11d8a342e4f7e91b1c6f22b8d6e43 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:25:59.632405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:25:59.642090 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191f054-a7ba-452c-8af5-c497d458d722 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:25:59.651029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:25:59.700309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:25:59.701209 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:25:59.701569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:25:59.701871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] PATH_INFO: `/v3/users/522b3ac532cb4683ba4a8501aec7902e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:25:59.703088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522b3ac532cb4683ba4a8501aec7902e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:25:59.705254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:25:59.920871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522b3ac532cb4683ba4a8501aec7902e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.921582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522b3ac532cb4683ba4a8501aec7902e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.922183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522b3ac532cb4683ba4a8501aec7902e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.934877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522b3ac532cb4683ba4a8501aec7902e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:25:59.941872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ef6815bf-03b1-4e9a-8530-8e77789314f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522b3ac532cb4683ba4a8501aec7902e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:00.020010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1331/2632] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:25:59 2022] DELETE /identity/v3/users/522b3ac532cb4683ba4a8501aec7902e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:00.455527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.455527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:00.480829 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4eebd-b9b4-4195-b4e2-0ec2c89cd2a0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.534636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:00.559429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.560368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.560696 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.560932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] PATH_INFO: `/v3/projects/f4ffbda9791f444ca6a191efd4e13fd6` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.562250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ffbda9791f444ca6a191efd4e13fd6)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.564219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.686668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ffbda9791f444ca6a191efd4e13fd6', 'request_id': 'req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:00.691990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ffbda9791f444ca6a191efd4e13fd6', 'request_id': 'req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:00.698586 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ffbda9791f444ca6a191efd4e13fd6', 'request_id': 'req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:00.775174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] The token cache is being invalidate because project f4ffbda9791f444ca6a191efd4e13fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:00.775472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:00.776109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d66d61cc-dd88-46cc-8b92-25ffc82e04e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:00.778520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1302/2633] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:00 2022] DELETE /identity/v3/projects/f4ffbda9791f444ca6a191efd4e13fd6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:00.783394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.783875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.783982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.808703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:00.810225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:00.881150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1332/2634] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:00.891042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.891365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.891654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.910485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:00.911725 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:00.920974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1303/2635] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:00.925580 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.936377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67d5c-69c0-4d9b-9997-1154934554f9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.941350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.942007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.942311 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.942585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.943374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:00.943684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.945910 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:00.957387 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1333/2636] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:00.962590 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:00.972287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30817a11-fae3-4e5f-8430-f1fe1e882d2e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:00.977033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:00.982789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:00.982789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:00.982789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:00.982789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:00.982789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.089723 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1304/2637] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:00 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:01.093830 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.107466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528651-2e2b-4693-96a2-c5491ffaafb7 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.127486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.169536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.170219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.170508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.170789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.171530 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.173527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.247409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1334/2638] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:01 2022] POST /identity/v3/users => generated 304 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:01.251577 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.262693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d0b3c-5ebc-4c3e-8e7b-0affae667988 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.267477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.268108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.268395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.268680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.269429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.271014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.282113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1305/2639] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:01.286351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.296847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b4418-0ad0-448f-a8c6-163cfcb1df17 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.301491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde8d27-0f3f-4fea-898c-96ed39dfef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.302154 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde8d27-0f3f-4fea-898c-96ed39dfef80 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.302442 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde8d27-0f3f-4fea-898c-96ed39dfef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.302726 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde8d27-0f3f-4fea-898c-96ed39dfef80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.303498 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde8d27-0f3f-4fea-898c-96ed39dfef80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.305714 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde8d27-0f3f-4fea-898c-96ed39dfef80 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.315973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1335/2640] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:01.320270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.333757 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777bd2b-4bd0-45bf-8bc7-c7f2bdf30d5c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.338442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.339356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.339644 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.339922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] PATH_INFO: `/v3/projects/9f618de374bb4b60a1a0a2ccc90bae76/users/a945828f8df04574a1e94804f0b47959/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.355078 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f618de374bb4b60a1a0a2ccc90bae76, user_id=a945828f8df04574a1e94804f0b47959, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.357755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.425522 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1306/2641] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:01 2022] PUT /identity/v3/projects/9f618de374bb4b60a1a0a2ccc90bae76/users/a945828f8df04574a1e94804f0b47959/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:01.484982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.485327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.485563 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.512771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] MFA Rules not processed for user `a945828f8df04574a1e94804f0b47959`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:01.513986 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:01.580609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1336/2642] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:01.592220 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.654604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646f22-ada1-48cb-8d45-08184affec6f admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.659591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.660506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.660791 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.661067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.661766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.664420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.672576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:01.764133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1307/2643] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:01 2022] POST /identity/v3/projects => generated 409 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:01.767954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.779068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071772-d7ed-41b3-9511-fd834bb62a6d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.835549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.836276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.836559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.836834 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.837522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.839480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.922933 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1337/2644] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:01 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:01.926857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.937354 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae448e-d8f7-45bf-bde7-871439383ca7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.942024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.942710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.942997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.943312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.944041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.945629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.956300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1308/2645] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:01.960813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:01.971148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850903-6356-4805-b863-305b978c1033 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:01.976360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:01.977236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:01.977517 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:01.977787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] PATH_INFO: `/v3/projects/12f157d9da3c4c7f82baad71516abf98/users/95c5bab1f72d468fa95a95e0660ce118/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:01.992227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f157d9da3c4c7f82baad71516abf98, user_id=95c5bab1f72d468fa95a95e0660ce118, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:01.994895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:01.997085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:02.042319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1338/2646] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:01 2022] PUT /identity/v3/projects/12f157d9da3c4c7f82baad71516abf98/users/95c5bab1f72d468fa95a95e0660ce118/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:02.046109 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.056002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbf5dd-f95e-43c7-bfcf-86630adb8f66 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:02.118470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe969-2333-43ad-84d1-2f5175bcb34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:02.119181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe969-2333-43ad-84d1-2f5175bcb34c admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.119471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe969-2333-43ad-84d1-2f5175bcb34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.119758 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe969-2333-43ad-84d1-2f5175bcb34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.120511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fe969-2333-43ad-84d1-2f5175bcb34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:02.122127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fe969-2333-43ad-84d1-2f5175bcb34c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:02.131561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1309/2647] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:02.136262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.149678 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b9c3-d0b5-435d-b8c0-77ad95592167 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:02.154273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:02.155168 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.155461 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.155738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] PATH_INFO: `/v3/projects/12f157d9da3c4c7f82baad71516abf98/users/95c5bab1f72d468fa95a95e0660ce118/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.157692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f157d9da3c4c7f82baad71516abf98, user_id=95c5bab1f72d468fa95a95e0660ce118, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:02.160755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:02.170727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1339/2648] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:02 2022] PUT /identity/v3/projects/12f157d9da3c4c7f82baad71516abf98/users/95c5bab1f72d468fa95a95e0660ce118/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:02.180604 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.180933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.181212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.207323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] MFA Rules not processed for user `95c5bab1f72d468fa95a95e0660ce118`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:02.208527 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:02.279121 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1310/2649] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:02.289759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.291471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:02.347424 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b1b99-74e7-48ae-94d9-7e611a708c96 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:02.351060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:02.351729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.352015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.352294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.362014 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:02.363491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:02.373831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1340/2650] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:02.775398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:02.783482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90340bd-223c-4a93-9750-2183f6b2af7f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:02.787223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b7dfe-e295-430d-92a0-078bb371c37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:02.787856 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b7dfe-e295-430d-92a0-078bb371c37d service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:02.788143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b7dfe-e295-430d-92a0-078bb371c37d service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:02.788463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b7dfe-e295-430d-92a0-078bb371c37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:02.846085 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b7dfe-e295-430d-92a0-078bb371c37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:02.847684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b7dfe-e295-430d-92a0-078bb371c37d service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:02.852377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:02.858015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1311/2651] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:03.708518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:03.710150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:03.777268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e7a37-0e38-4de1-97bd-7cf36d1eb383 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:03.782018 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:03.783009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:03.783252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:03.783608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] PATH_INFO: `/v3/users/07ef9d9bc69240bf96b84c19eba264cb` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:03.785162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ef9d9bc69240bf96b84c19eba264cb)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:03.787125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:03.936457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ef9d9bc69240bf96b84c19eba264cb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:03.937672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ef9d9bc69240bf96b84c19eba264cb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:03.937865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ef9d9bc69240bf96b84c19eba264cb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:03.951320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ef9d9bc69240bf96b84c19eba264cb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:03.958686 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ef9d9bc69240bf96b84c19eba264cb'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:04.042219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1341/2652] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:03 2022] DELETE /identity/v3/users/07ef9d9bc69240bf96b84c19eba264cb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:04.046535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.046995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.047083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.064986 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:04.066162 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:04.123256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1312/2653] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:04.133323 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.134697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:04.140002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:04.194068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635986b-216a-41d2-84b2-4e636ae2dff1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.198316 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.198956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.199297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.199577 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.209386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:04.210900 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:04.220575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1342/2654] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:04.614383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.617165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:04.652067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb52d-591c-4c7e-b0dc-2165caeadaa2 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.653973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.654875 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.655259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.655539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] PATH_INFO: `/v3/projects/1a938ac4d8b74b5bb75658bee5816a40` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.656755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a938ac4d8b74b5bb75658bee5816a40)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:04.658706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:04.785879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a938ac4d8b74b5bb75658bee5816a40', 'request_id': 'req-e05d0baa-b9e4-4246-8eba-49076d2e3925'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:04.792261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a938ac4d8b74b5bb75658bee5816a40', 'request_id': 'req-e05d0baa-b9e4-4246-8eba-49076d2e3925'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:04.798432 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a938ac4d8b74b5bb75658bee5816a40', 'request_id': 'req-e05d0baa-b9e4-4246-8eba-49076d2e3925'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:04.921781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] The token cache is being invalidate because project 1a938ac4d8b74b5bb75658bee5816a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:04.922080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:04.922694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:04.924309 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1313/2655] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:04 2022] DELETE /identity/v3/projects/1a938ac4d8b74b5bb75658bee5816a40 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:04.928476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:04.938131 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160abc91-1c1a-46b2-b794-cd22859e8336 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:04.995990 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860c31-3757-4853-b616-2740121087cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:04.996877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860c31-3757-4853-b616-2740121087cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:04.997167 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860c31-3757-4853-b616-2740121087cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:04.997471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860c31-3757-4853-b616-2740121087cc admin admin] PATH_INFO: `/v3/users/e447accac8134ecca70a5abdf16021f6` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:04.998665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860c31-3757-4853-b616-2740121087cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e447accac8134ecca70a5abdf16021f6)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.000639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860c31-3757-4853-b616-2740121087cc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.222578 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31860c31-3757-4853-b616-2740121087cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e447accac8134ecca70a5abdf16021f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:05.223189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31860c31-3757-4853-b616-2740121087cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e447accac8134ecca70a5abdf16021f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:05.223794 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31860c31-3757-4853-b616-2740121087cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e447accac8134ecca70a5abdf16021f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:05.236275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31860c31-3757-4853-b616-2740121087cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e447accac8134ecca70a5abdf16021f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:05.243170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-31860c31-3757-4853-b616-2740121087cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e447accac8134ecca70a5abdf16021f6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:05.333522 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1343/2656] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:04 2022] DELETE /identity/v3/users/e447accac8134ecca70a5abdf16021f6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:05.774417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:05.775870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:05.795729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0baa-b9e4-4246-8eba-49076d2e3925 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:05.854897 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:05.855825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:05.856097 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:05.856371 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] PATH_INFO: `/v3/projects/2bc44b349f9b402cac7b2970ea5a2716` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:05.857698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc44b349f9b402cac7b2970ea5a2716)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:05.859641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:05.886249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:05.997664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc44b349f9b402cac7b2970ea5a2716', 'request_id': 'req-a8025097-f549-421e-bf5d-5836728a0491'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:06.003037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc44b349f9b402cac7b2970ea5a2716', 'request_id': 'req-a8025097-f549-421e-bf5d-5836728a0491'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:06.009112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc44b349f9b402cac7b2970ea5a2716', 'request_id': 'req-a8025097-f549-421e-bf5d-5836728a0491'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:06.105308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] The token cache is being invalidate because project 2bc44b349f9b402cac7b2970ea5a2716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:06.105594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:06.106206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a8025097-f549-421e-bf5d-5836728a0491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:06.107799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1314/2657] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:05 2022] DELETE /identity/v3/projects/2bc44b349f9b402cac7b2970ea5a2716 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:06.112643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.113113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.113211 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.131486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:06.132684 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:06.152103 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:06.203786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1344/2658] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:06.223417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.223767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.224057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.245317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:06.246515 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:06.255151 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1315/2659] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:06.259870 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.269675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa7015-a669-4874-ae7b-72cf73847911 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.274890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.275515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.275801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.276079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.277438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:06.277754 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.279398 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.292693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1345/2660] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:06.297382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.307180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b785b-e90d-4147-aa92-2f95d707e1af None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.311854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.312509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.312795 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.314468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.314468 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.315682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.396194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1316/2661] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:06.400548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.410583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927062fe-22ff-44b5-8179-bc45ea1b7867 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.465931 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.466600 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.466887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.467196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.467898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.469849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.540059 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1346/2662] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:06.544120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.555311 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19ed08-bc3a-4501-b4ec-e978abcd0278 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.560022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.560689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.560981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.561264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.562001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.563634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.573945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1317/2663] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:06.577819 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.588058 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e806-8e6e-49c0-ae05-b7613410710a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.592670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6857f-176b-43f8-ba02-ac895d130fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.593319 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6857f-176b-43f8-ba02-ac895d130fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.593606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6857f-176b-43f8-ba02-ac895d130fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.593889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6857f-176b-43f8-ba02-ac895d130fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.594614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6857f-176b-43f8-ba02-ac895d130fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.596250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6857f-176b-43f8-ba02-ac895d130fd8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.606444 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1347/2664] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:06.610365 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.620761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04670d-f0c3-4652-b0c8-4eab5ae1b359 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.625436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.626314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.626608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.626889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] PATH_INFO: `/v3/projects/188ea412d7cd4c7eaf1bc6257f69e0a2/users/71db0cc5352649a688b68a58cc3bd95f/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.641174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] RBAC: Authorizing `identity:create_grant(project_id=188ea412d7cd4c7eaf1bc6257f69e0a2, user_id=71db0cc5352649a688b68a58cc3bd95f, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.643851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.716111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1318/2665] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:06 2022] PUT /identity/v3/projects/188ea412d7cd4c7eaf1bc6257f69e0a2/users/71db0cc5352649a688b68a58cc3bd95f/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:06.726282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.726574 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.726853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.752593 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] MFA Rules not processed for user `71db0cc5352649a688b68a58cc3bd95f`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:06.753823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:06.816229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1348/2666] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:06.821361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.882383 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe49f-8af0-420f-be17-6e461f99217d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:06.887160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:06.887813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:06.888113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:06.888378 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:06.889073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:06.890960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:06.970208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1319/2667] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:06.974071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:06.985233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82959790-6690-4cb1-9731-bde618f68b13 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.001707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.041817 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.042513 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.042911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.043233 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.043915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.045824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.128660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1349/2668] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:06 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:07.132592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.142985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96258739-e6b1-40e0-a889-aca0af6c992e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.148250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.148914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.149201 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.149507 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.150330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.151968 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.162707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1320/2669] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:07.167594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.177514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82caf3-4cc5-430c-980a-9078dd3535d4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.185612 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.186496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.186780 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.187060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] PATH_INFO: `/v3/projects/57ae78a966634396b8d949e2184199e1/users/0c1e67af0ed340e8afd525618845cf29/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.202031 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ae78a966634396b8d949e2184199e1, user_id=0c1e67af0ed340e8afd525618845cf29, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.204758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.276797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1350/2670] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:07 2022] PUT /identity/v3/projects/57ae78a966634396b8d949e2184199e1/users/0c1e67af0ed340e8afd525618845cf29/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:07.280748 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.290878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50a65-fa5a-4845-94ad-dd535a586bdc admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.308692 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:07.346160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644440-f673-4fbd-9a85-c7d1a33bc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.346759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644440-f673-4fbd-9a85-c7d1a33bc85a admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.347044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644440-f673-4fbd-9a85-c7d1a33bc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.347342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644440-f673-4fbd-9a85-c7d1a33bc85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.348064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644440-f673-4fbd-9a85-c7d1a33bc85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.349659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644440-f673-4fbd-9a85-c7d1a33bc85a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.359166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1321/2671] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:07.363218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.373379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ba6b5-44d1-4d54-8b9d-8142a63f2de3 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.377887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.381223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.381223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.381223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] PATH_INFO: `/v3/projects/57ae78a966634396b8d949e2184199e1/users/0c1e67af0ed340e8afd525618845cf29/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.381223 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ae78a966634396b8d949e2184199e1, user_id=0c1e67af0ed340e8afd525618845cf29, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.384397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.394380 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1351/2672] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:07 2022] PUT /identity/v3/projects/57ae78a966634396b8d949e2184199e1/users/0c1e67af0ed340e8afd525618845cf29/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:07.404894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.405183 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.405464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.431690 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] MFA Rules not processed for user `0c1e67af0ed340e8afd525618845cf29`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:07.432869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:07.499072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1322/2673] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:07.510032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.511732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:07.567452 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c22ac-2e4d-4a11-8f36-94885e2b4c13 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.571641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.572279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.572570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.572847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.581664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.583115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.593315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1352/2674] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:07.637953 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:07.639372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:07.651175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d938-87e9-452c-8807-65707579bceb None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:07.654805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5589d-4ff5-4ed5-8fb9-3f08382814af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:07.655502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5589d-4ff5-4ed5-8fb9-3f08382814af service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:07.655785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5589d-4ff5-4ed5-8fb9-3f08382814af service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:07.656058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5589d-4ff5-4ed5-8fb9-3f08382814af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:07.710488 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5589d-4ff5-4ed5-8fb9-3f08382814af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:07.711992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5589d-4ff5-4ed5-8fb9-3f08382814af service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:07.720873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1323/2675] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:17.589146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:17.716805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=81 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:22.118712 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.120158 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:22.185354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8ce6-0fdb-4271-bada-24efd745a91e service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.189963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.190825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.191122 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.191409 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] PATH_INFO: `/v3/users/a945828f8df04574a1e94804f0b47959` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.192582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a945828f8df04574a1e94804f0b47959)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.194587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.341270 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a945828f8df04574a1e94804f0b47959'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:22.341914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a945828f8df04574a1e94804f0b47959'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:22.342512 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a945828f8df04574a1e94804f0b47959'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:22.354961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a945828f8df04574a1e94804f0b47959'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:22.361952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a945828f8df04574a1e94804f0b47959'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:22.424659 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1353/2676] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:22 2022] DELETE /identity/v3/users/a945828f8df04574a1e94804f0b47959 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:22.429400 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.429895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.430021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.447915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:22.449113 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:22.507703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1324/2677] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:22.517366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.518752 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:22.575663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168303-5d83-4a85-9e1b-20792d908b52 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.579343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.579978 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.580263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.580536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.589921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.591393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:22.600702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1354/2678] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:22.881600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:22.883025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:22.898262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220da8d-06ce-4d9a-9d1f-3983ad44747f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:22.903412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:22.904305 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:22.904588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:22.904869 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] PATH_INFO: `/v3/users/71db0cc5352649a688b68a58cc3bd95f` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:22.906212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71db0cc5352649a688b68a58cc3bd95f)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:22.908750 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.025707 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.027166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.050282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782dd8b-c34f-4349-8a0c-1017aa80e4a2 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.057110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.058453 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.058762 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.059111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] PATH_INFO: `/v3/projects/9f618de374bb4b60a1a0a2ccc90bae76` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.060416 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f618de374bb4b60a1a0a2ccc90bae76)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.062388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.081968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.102512 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71db0cc5352649a688b68a58cc3bd95f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.184326 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71db0cc5352649a688b68a58cc3bd95f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.184989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71db0cc5352649a688b68a58cc3bd95f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.197052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f618de374bb4b60a1a0a2ccc90bae76', 'request_id': 'req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.201483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71db0cc5352649a688b68a58cc3bd95f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.208415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfa6420-833c-4760-9f27-750bc164c115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71db0cc5352649a688b68a58cc3bd95f'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.215090 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1325/2679] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:22 2022] DELETE /identity/v3/users/71db0cc5352649a688b68a58cc3bd95f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:23.219362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.219653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.219931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.240676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:23.240676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.282708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f618de374bb4b60a1a0a2ccc90bae76', 'request_id': 'req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.293525 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f618de374bb4b60a1a0a2ccc90bae76', 'request_id': 'req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.302060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1326/2680] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:23.309397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] The token cache is being invalidate because project 9f618de374bb4b60a1a0a2ccc90bae76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:23.309663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.310374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.311960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1355/2681] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:23 2022] DELETE /identity/v3/projects/9f618de374bb4b60a1a0a2ccc90bae76 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:23.314087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.315526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.315755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.321096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.330770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:23.375883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bca45-662f-4423-8e38-75189682aab3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.379974 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.380785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.381070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.381345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.383179 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.384967 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc69e2-2456-4f6b-9e09-26fc0d3f3aa9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.390464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.391650 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.391939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.392222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] PATH_INFO: `/v3/users/95c5bab1f72d468fa95a95e0660ce118` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.393423 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c5bab1f72d468fa95a95e0660ce118)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.395614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.398397 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.399985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:23.411663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1327/2682] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:23.660503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c5bab1f72d468fa95a95e0660ce118'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.661623 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c5bab1f72d468fa95a95e0660ce118'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.662238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c5bab1f72d468fa95a95e0660ce118'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.678462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c5bab1f72d468fa95a95e0660ce118'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.688220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c5bab1f72d468fa95a95e0660ce118'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:23.780220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1356/2683] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:23 2022] DELETE /identity/v3/users/95c5bab1f72d468fa95a95e0660ce118 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:23.844131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:23.845684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:23.873494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bb46-5862-412a-aa47-5e3ce32cd008 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:23.926992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:23.928048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:23.928402 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:23.928709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] PATH_INFO: `/v3/projects/188ea412d7cd4c7eaf1bc6257f69e0a2` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:23.929891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=188ea412d7cd4c7eaf1bc6257f69e0a2)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:23.932467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.083337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188ea412d7cd4c7eaf1bc6257f69e0a2', 'request_id': 'req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.089337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188ea412d7cd4c7eaf1bc6257f69e0a2', 'request_id': 'req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.095499 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188ea412d7cd4c7eaf1bc6257f69e0a2', 'request_id': 'req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.190698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] The token cache is being invalidate because project 188ea412d7cd4c7eaf1bc6257f69e0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:24.190900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.191550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.193144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1328/2684] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:23 2022] DELETE /identity/v3/projects/188ea412d7cd4c7eaf1bc6257f69e0a2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:24.198049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.199466 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:24.212598 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68070178-fad2-46cc-99b9-d34646a0774a admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.232184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.239533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.241475 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:24.276827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.277702 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.277983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.278262 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] PATH_INFO: `/v3/users/0c1e67af0ed340e8afd525618845cf29` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.279474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1e67af0ed340e8afd525618845cf29)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.281449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.304537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.322447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af812e7c-82ef-4e0a-a4c4-78afca9cc7bd admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.327172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.328025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.328308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.328585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] PATH_INFO: `/v3/projects/12f157d9da3c4c7f82baad71516abf98` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.329767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f157d9da3c4c7f82baad71516abf98)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.331724 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.479989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1e67af0ed340e8afd525618845cf29'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.480719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1e67af0ed340e8afd525618845cf29'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.480958 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f157d9da3c4c7f82baad71516abf98', 'request_id': 'req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.481413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1e67af0ed340e8afd525618845cf29'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.486448 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f157d9da3c4c7f82baad71516abf98', 'request_id': 'req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.493362 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f157d9da3c4c7f82baad71516abf98', 'request_id': 'req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.493840 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1e67af0ed340e8afd525618845cf29'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.500984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1e67af0ed340e8afd525618845cf29'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.574168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] The token cache is being invalidate because project 12f157d9da3c4c7f82baad71516abf98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:24.574580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.575273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-abfaab6a-dc0a-4768-b4f5-549ff382fb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:24.577168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1329/2685] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:24 2022] DELETE /identity/v3/projects/12f157d9da3c4c7f82baad71516abf98 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:24.581872 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24d2f9-d40c-4a1e-b39b-f2bf94a7dfef None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.582731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24d2f9-d40c-4a1e-b39b-f2bf94a7dfef None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.582731 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24d2f9-d40c-4a1e-b39b-f2bf94a7dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.605032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-da24d2f9-d40c-4a1e-b39b-f2bf94a7dfef None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:24.607351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-da24d2f9-d40c-4a1e-b39b-f2bf94a7dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:24.668898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1330/2686] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:24.677763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.678060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.678345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.698192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:24.709870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:24.710140 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1357/2687] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:24 2022] DELETE /identity/v3/users/0c1e67af0ed340e8afd525618845cf29 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:24.787315 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.788988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:24.793040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1331/2688] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:26:24.810149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8013-4c25-487a-b9a7-76fb6cc56748 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.819871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.821166 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.822622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.823002 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.824161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:24.827215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.827215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.839289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1358/2689] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:24.843882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:24.853145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea638-e407-4891-9435-0a98bf1f706b None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:24.857825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:24.858506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:24.858792 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:24.859073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:24.859800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:24.861707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:24.876060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:24.997740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1332/2690] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:24 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:24.998486 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.011426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef00a-9dca-45d1-a797-1c9e01b5a765 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.081413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.082116 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.082404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.082682 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.083430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.085390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.202622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1359/2691] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:24 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:25.209491 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.220250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3adfa-0aa7-4c96-8583-f2e47d8c2722 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.225294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.226370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.226660 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.226940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.227732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.229538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.237282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.241547 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.245844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1333/2692] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:25.249325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.254687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ba5e-d75a-444f-b0ae-5c8a1e38d990 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.260370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.264204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.264204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.264204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] PATH_INFO: `/v3/projects/57ae78a966634396b8d949e2184199e1` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.264523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31fa76-2973-49c2-904a-962b5c3e48fa admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.264603 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ae78a966634396b8d949e2184199e1)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.265035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.268526 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.269519 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.270145 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.270610 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.271618 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.273558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.286992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1334/2693] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:25.289413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.289956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.300498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf983-276e-4dda-b0e0-27bc836e1126 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.305119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff7f4-0ffe-4109-a23f-2e1c334245f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.310165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff7f4-0ffe-4109-a23f-2e1c334245f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.310165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff7f4-0ffe-4109-a23f-2e1c334245f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.310165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff7f4-0ffe-4109-a23f-2e1c334245f4 admin admin] PATH_INFO: `/v3/projects/8524c10fb51a4f3e8fd5987302fdcb71/users/ab227fc1e13247acbd3cca836cc3717a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.321063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff7f4-0ffe-4109-a23f-2e1c334245f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8524c10fb51a4f3e8fd5987302fdcb71, user_id=ab227fc1e13247acbd3cca836cc3717a, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.324450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff7f4-0ffe-4109-a23f-2e1c334245f4 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.404529 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1335/2694] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:25 2022] PUT /identity/v3/projects/8524c10fb51a4f3e8fd5987302fdcb71/users/ab227fc1e13247acbd3cca836cc3717a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:25.413565 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ae78a966634396b8d949e2184199e1', 'request_id': 'req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.415088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.415423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.415700 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.440796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] MFA Rules not processed for user `ab227fc1e13247acbd3cca836cc3717a`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:25.442067 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.470647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ae78a966634396b8d949e2184199e1', 'request_id': 'req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.477962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ae78a966634396b8d949e2184199e1', 'request_id': 'req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.489975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] The token cache is being invalidate because project 57ae78a966634396b8d949e2184199e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:25.490482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.491217 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-848bde8f-66e6-4bed-bee7-ec4cc4b9d774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.492797 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1360/2695] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:25 2022] DELETE /identity/v3/projects/57ae78a966634396b8d949e2184199e1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:25.502335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.502594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.502954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.512833 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1336/2696] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:25.521546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:25.522738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.524306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.526301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.585396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1361/2697] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:25.585743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9c80-5130-4f8c-9e30-e1e1d2fa6950 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.589975 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d5c7e-7e6a-4974-afd7-fd263352adea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.590639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5c7e-7e6a-4974-afd7-fd263352adea service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.590927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5c7e-7e6a-4974-afd7-fd263352adea service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.591248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5c7e-7e6a-4974-afd7-fd263352adea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.601596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5c7e-7e6a-4974-afd7-fd263352adea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.603087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5c7e-7e6a-4974-afd7-fd263352adea service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.614116 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1337/2698] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:26:25.636847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.638342 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.644910 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.645209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.645540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.651706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c595a19-4224-4b23-94ac-4a6f902f1c76 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.657587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.658892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.659202 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.659488 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] PATH_INFO: `/v3/users/ab227fc1e13247acbd3cca836cc3717a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.660983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab227fc1e13247acbd3cca836cc3717a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.663016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.663862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:25.665061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.672972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1338/2699] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:26:25.677068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.686602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa275d-b8f2-4dca-b62d-7da7c4aefbce None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.691254 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.691894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.692180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.692456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.693175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:25.693508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.695144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.707279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1339/2700] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:25.711677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.721044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69769dd-8815-4767-9b13-34ba00b1c1e3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.725763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.726388 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.726819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.726948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.728193 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.729639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.832427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.838189 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1340/2701] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:25 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:25.842374 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.844863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab227fc1e13247acbd3cca836cc3717a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.845524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab227fc1e13247acbd3cca836cc3717a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.846208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab227fc1e13247acbd3cca836cc3717a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.858386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab227fc1e13247acbd3cca836cc3717a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.865734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-ec47c547-9bf8-4b6c-8629-fa3a5207ebde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab227fc1e13247acbd3cca836cc3717a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:25.903630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2cd65-e2b4-4593-ab7d-b15f0957ba25 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:25.908424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:25.909089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.909377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.909656 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.910596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:25.912534 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:25.927622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1362/2702] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:25 2022] DELETE /identity/v3/users/ab227fc1e13247acbd3cca836cc3717a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:25.933142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:25.933430 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:25.933710 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:25.951540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:25.952727 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:25.961669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:25.991687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1341/2703] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:25 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:25.996283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:25.998068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.009994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56abb-920f-4081-a922-027a42f07af7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.013009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1363/2704] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:26:26.017260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.017260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.017260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.017260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.017607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.018153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.025579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.027146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.031423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1342/2705] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:26:26.032802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.043546 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afa8c3-44cc-4f7f-951e-57d8a7f90965 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.048386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.049306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.049602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.049887 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.050645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.052273 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.067181 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1343/2706] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:26:26.070882 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.082990 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a4f0-e72c-41b4-abcd-60d5da2c9903 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.088380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.089292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.089574 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.089850 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] PATH_INFO: `/v3/projects/08900872db7f4f41bb9509e9baeff66b/users/a50fb6049247411e887d0875b2124b81/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.090811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879907a-b2e6-4c14-b5c7-67856af6a2fa None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.101023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8c7c5-5792-41d9-87a8-43ef920c5b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.101677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c7c5-5792-41d9-87a8-43ef920c5b06 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.101965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c7c5-5792-41d9-87a8-43ef920c5b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.102245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c7c5-5792-41d9-87a8-43ef920c5b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.112889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=08900872db7f4f41bb9509e9baeff66b, user_id=a50fb6049247411e887d0875b2124b81, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.113066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8c7c5-5792-41d9-87a8-43ef920c5b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.114429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8c7c5-5792-41d9-87a8-43ef920c5b06 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.115682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.124639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1364/2707] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:26:26.180284 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1344/2708] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:26 2022] PUT /identity/v3/projects/08900872db7f4f41bb9509e9baeff66b/users/a50fb6049247411e887d0875b2124b81/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:26.191354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.191837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.192236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.221758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] MFA Rules not processed for user `a50fb6049247411e887d0875b2124b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:26.223064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.290146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1365/2709] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:26.294641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.361436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f96e0-40ed-441a-8fc0-9a5c6808ecac admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.366149 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.366820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.372013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.372013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.372013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.372013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.481863 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1345/2710] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/projects => generated 401 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:26.485962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.497328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dc5d-7bb3-429a-a135-a229506742a5 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.541924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:26.552342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.554106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.554250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.554974 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.555347 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.555703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.556479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.558590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.579304 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be962-f04f-42d8-8730-38bb6e375002 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.584464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.585458 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.585816 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.586107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] PATH_INFO: `/v3/projects/8524c10fb51a4f3e8fd5987302fdcb71` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.587886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8524c10fb51a4f3e8fd5987302fdcb71)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.589798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.614773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:26.674913 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1366/2711] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/users => generated 307 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:26.676089 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.685825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcadb14-7ad8-4297-bb21-70927c063795 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.687308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8524c10fb51a4f3e8fd5987302fdcb71', 'request_id': 'req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:26.695997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8524c10fb51a4f3e8fd5987302fdcb71', 'request_id': 'req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:26.704454 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8524c10fb51a4f3e8fd5987302fdcb71', 'request_id': 'req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:26.749811 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.750357 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] The token cache is being invalidate because project 8524c10fb51a4f3e8fd5987302fdcb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:26.750561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.750659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:26.750835 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.751135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.751330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-c05a7e30-9cb1-41f2-b217-f13cb1488e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:26.751916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.752929 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1346/2712] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:26 2022] DELETE /identity/v3/projects/8524c10fb51a4f3e8fd5987302fdcb71 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:26.756971 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.757693 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53355f-7813-4cf3-8f69-940625601b49 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.757979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53355f-7813-4cf3-8f69-940625601b49 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.758263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53355f-7813-4cf3-8f69-940625601b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.768824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1367/2713] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:26.773232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.783198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.783335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-eb53355f-7813-4cf3-8f69-940625601b49 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:26.783335 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-eb53355f-7813-4cf3-8f69-940625601b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.787596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1347/2714] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:26:26.788200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2c3c-9ee2-4e25-b3a3-8555e9ec318b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.792912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.793796 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.794086 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.794546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] PATH_INFO: `/v3/projects/f231773d32434bd689ecbfba78613bde/users/db73b912d6fa4284aad3894e78d3d966/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.795406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.795714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.795981 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.810422 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f231773d32434bd689ecbfba78613bde, user_id=db73b912d6fa4284aad3894e78d3d966, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.813212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:26.813350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.814403 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:26.822830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1348/2715] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:26:26.826857 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.836003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c660e-e782-4046-b261-55b29e46ba93 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.841331 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.841972 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.842257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.842535 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.843293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:26.843600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.845163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.856785 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1349/2716] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:26.860997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.870227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0c7c-2019-4148-9aaa-406ab7221195 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.874904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.876533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.876533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.876533 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.876922 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.878756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.894300 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1368/2717] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:26 2022] PUT /identity/v3/projects/f231773d32434bd689ecbfba78613bde/users/db73b912d6fa4284aad3894e78d3d966/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:26.898115 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.959137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea193-cd8d-4178-962e-5a325a75b678 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.964413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:26.965072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:26.965360 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:26.965640 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:26.966393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:26.968098 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:26.977649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1369/2718] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:26:26.981874 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:26.991198 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1350/2719] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:26.991989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf928c70-96b2-453e-ba3a-e3a1842718c5 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:26.992099 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.039309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.051679 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f940c1b-6983-47cd-ae4e-97a9d9b2613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.052621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f940c1b-6983-47cd-ae4e-97a9d9b2613f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.052906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f940c1b-6983-47cd-ae4e-97a9d9b2613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.053183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f940c1b-6983-47cd-ae4e-97a9d9b2613f admin admin] PATH_INFO: `/v3/projects/f231773d32434bd689ecbfba78613bde/users/db73b912d6fa4284aad3894e78d3d966/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.054382 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb397-3d92-4edb-9a98-cd62f0a9b316 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.055180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f940c1b-6983-47cd-ae4e-97a9d9b2613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f231773d32434bd689ecbfba78613bde, user_id=db73b912d6fa4284aad3894e78d3d966, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.057861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f940c1b-6983-47cd-ae4e-97a9d9b2613f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.058961 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.059772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.060057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.060330 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.061009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.062886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.067906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1370/2720] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:26 2022] PUT /identity/v3/projects/f231773d32434bd689ecbfba78613bde/users/db73b912d6fa4284aad3894e78d3d966/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:27.079599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.079916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.080196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.107227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] MFA Rules not processed for user `db73b912d6fa4284aad3894e78d3d966`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:27.108467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:27.181599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1371/2721] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:26:27.192202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1351/2722] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:26 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:27.194415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.196080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.196267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:27.207233 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a189f-0fec-45ce-9848-33cea84831e3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.255894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93889194-ab29-4289-a082-ccf4f04921ea None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.260200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.260359 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.260854 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.261141 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.261420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.269260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.270002 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.270355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.270680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.270794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.271588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.272156 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.273294 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.282150 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1372/2723] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:26:27.284909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1352/2724] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:26:27.287764 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.299260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc046-8a88-4397-a818-7e8809296e2c service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.305456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f8c1-7395-49d2-9c89-b64ae807e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.306709 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f8c1-7395-49d2-9c89-b64ae807e046 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.306994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f8c1-7395-49d2-9c89-b64ae807e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.307312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f8c1-7395-49d2-9c89-b64ae807e046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.308046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f8c1-7395-49d2-9c89-b64ae807e046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.309829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f8c1-7395-49d2-9c89-b64ae807e046 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.319980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1373/2725] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:26:27.324835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.334741 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9555-1455-4c2b-98c4-761cc7244df3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.339452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.342263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.342263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.342263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] PATH_INFO: `/v3/projects/88b2957cf70c4ba6b18865ead09a8b4a/users/347470f4732344a7a76a521b29bb803c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.354979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b2957cf70c4ba6b18865ead09a8b4a, user_id=347470f4732344a7a76a521b29bb803c, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.357648 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.470992 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1353/2726] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:27 2022] PUT /identity/v3/projects/88b2957cf70c4ba6b18865ead09a8b4a/users/347470f4732344a7a76a521b29bb803c/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:27.482361 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.482657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.482937 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.498015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.510479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] MFA Rules not processed for user `347470f4732344a7a76a521b29bb803c`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:27.511718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:27.558787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea27d2-01c3-4066-8bdc-84aacdae59fd admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.565236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:27.565621 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.566327 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.567565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.567565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.568914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:27.590995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1374/2727] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:27.635384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.636738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.645729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1354/2728] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:26:27.754786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:27.756355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:27.769403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775fe2e-4f2f-4606-9c06-339f53f78437 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:27.773483 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d356f4e-1c6f-4c6b-a611-e8ebe88f25dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:27.777068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d356f4e-1c6f-4c6b-a611-e8ebe88f25dc service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:27.777068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d356f4e-1c6f-4c6b-a611-e8ebe88f25dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:27.777068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d356f4e-1c6f-4c6b-a611-e8ebe88f25dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:27.784033 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d356f4e-1c6f-4c6b-a611-e8ebe88f25dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:27.785721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d356f4e-1c6f-4c6b-a611-e8ebe88f25dc service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:27.794546 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1375/2729] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:28.272061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:28.273212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:28.355593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1328c9-cf27-4fed-9c63-2247f28ba567 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:28.360096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:28.360924 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.361195 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.361470 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] PATH_INFO: `/v3/users/b142b68adb024fe89a131af18c4cc2f6` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.362663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b142b68adb024fe89a131af18c4cc2f6)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:28.364730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:28.391260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:28.508045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b142b68adb024fe89a131af18c4cc2f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:28.590544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b142b68adb024fe89a131af18c4cc2f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:28.591209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b142b68adb024fe89a131af18c4cc2f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:28.604088 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b142b68adb024fe89a131af18c4cc2f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:28.610824 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b142b68adb024fe89a131af18c4cc2f6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:28.616778 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1355/2730] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:28 2022] DELETE /identity/v3/users/b142b68adb024fe89a131af18c4cc2f6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:28.621867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.622358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.622457 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.642867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:28.642867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:28.701111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1376/2731] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:28.710677 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:28.712096 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:28.768638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb50f5-3d0d-496e-af79-f8420ee4fab5 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:28.772222 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51d4e8-0257-4c6c-aa5d-056efab75aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:28.772866 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d4e8-0257-4c6c-aa5d-056efab75aae service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:28.773153 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d4e8-0257-4c6c-aa5d-056efab75aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:28.773440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d4e8-0257-4c6c-aa5d-056efab75aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:28.782367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d4e8-0257-4c6c-aa5d-056efab75aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:28.783835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d4e8-0257-4c6c-aa5d-056efab75aae service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:28.793538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1356/2732] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:29.174975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.176528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:29.189438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3fd4a-e478-46ed-bf08-7e9d8cfb18a2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.194080 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.194968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.195284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.195556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] PATH_INFO: `/v3/projects/bdc9364cabe147249c89e4a9042776d6` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.197245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc9364cabe147249c89e4a9042776d6)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.199220 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.351964 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc9364cabe147249c89e4a9042776d6', 'request_id': 'req-5a45461b-4d38-4571-854b-f649e5a97d60'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:29.425236 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc9364cabe147249c89e4a9042776d6', 'request_id': 'req-5a45461b-4d38-4571-854b-f649e5a97d60'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:29.432051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc9364cabe147249c89e4a9042776d6', 'request_id': 'req-5a45461b-4d38-4571-854b-f649e5a97d60'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:29.442708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] The token cache is being invalidate because project bdc9364cabe147249c89e4a9042776d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:29.442991 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:29.443800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5a45461b-4d38-4571-854b-f649e5a97d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:29.445553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1377/2733] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:29 2022] DELETE /identity/v3/projects/bdc9364cabe147249c89e4a9042776d6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:29.450440 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746eda-4685-4657-8a89-75921af9710f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.450942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746eda-4685-4657-8a89-75921af9710f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.450942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746eda-4685-4657-8a89-75921af9710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.470649 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bb746eda-4685-4657-8a89-75921af9710f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:29.471900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bb746eda-4685-4657-8a89-75921af9710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:29.534024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1357/2734] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:29.542584 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.542877 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.543189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.561588 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:29.562786 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:29.570730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1378/2735] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:29.574698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb746eda-4685-4657-8a89-75921af9710f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.584353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb746eda-4685-4657-8a89-75921af9710f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.589424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.590069 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.590349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.590624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.591385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:29.591709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.593268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.608775 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1358/2736] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:26:29.609935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.619282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b1b2-d827-42e7-a433-3446e1e2ad8e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.623988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.624636 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.624920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.625196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.625897 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.627920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.710178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1379/2737] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:29 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:29.711352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.722124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc7681-0309-41ea-809b-0b21acb7c454 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.747566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:29.778125 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.778798 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.779159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.779398 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.780084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.781982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.920634 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1359/2738] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:29 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:29.921722 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.933469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9667-7d46-446c-b65c-04bbca5bb8c6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.939278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.939961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.940245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.940519 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.941257 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.943730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.960232 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1380/2739] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:29.961263 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:29.973167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7f97-a78f-45b5-86ac-38ee5761543e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:29.978401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3ce4-314e-4c29-9a14-2f870237277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:29.979077 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3ce4-314e-4c29-9a14-2f870237277b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:29.979447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3ce4-314e-4c29-9a14-2f870237277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:29.979729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3ce4-314e-4c29-9a14-2f870237277b admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:29.980676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d3ce4-314e-4c29-9a14-2f870237277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:29.982375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d3ce4-314e-4c29-9a14-2f870237277b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:29.997068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1360/2740] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:29.998273 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:30.008373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922e14-792b-48b0-a1e4-58f7f87a1d88 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:30.013395 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:30.020378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.020378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.020378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] PATH_INFO: `/v3/projects/e2e16b4211704ad4aebf12c8cce8c13a/users/8baacb519ca04fb19366d5027f276833/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.029892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e16b4211704ad4aebf12c8cce8c13a, user_id=8baacb519ca04fb19366d5027f276833, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:30.032805 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:30.035176 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:30.109804 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1381/2741] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:29 2022] PUT /identity/v3/projects/e2e16b4211704ad4aebf12c8cce8c13a/users/8baacb519ca04fb19366d5027f276833/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:26:30.120637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.120927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.121211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.149095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] MFA Rules not processed for user `8baacb519ca04fb19366d5027f276833`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:30.150312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:30.213235 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1361/2742] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:30.224309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:30.225960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:30.285884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128f6aa-50c1-44a1-97ce-cdf9244499ac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:30.289629 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52023e7d-711e-4b7f-8220-e079d8ce9405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:30.290306 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52023e7d-711e-4b7f-8220-e079d8ce9405 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:30.290657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52023e7d-711e-4b7f-8220-e079d8ce9405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:30.290932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52023e7d-711e-4b7f-8220-e079d8ce9405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:30.299126 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52023e7d-711e-4b7f-8220-e079d8ce9405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:30.300562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52023e7d-711e-4b7f-8220-e079d8ce9405 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:30.309965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1382/2743] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:31.884227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:31.885637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:31.949249 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72202d9-18be-4582-8d82-387b6dd3a35a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:31.953755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:31.954627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:31.954917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:31.955232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] PATH_INFO: `/v3/users/347470f4732344a7a76a521b29bb803c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:31.956434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347470f4732344a7a76a521b29bb803c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:31.958364 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.187985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:32.193751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347470f4732344a7a76a521b29bb803c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:32.294413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347470f4732344a7a76a521b29bb803c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:32.295124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347470f4732344a7a76a521b29bb803c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:32.308175 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347470f4732344a7a76a521b29bb803c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:32.315905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347470f4732344a7a76a521b29bb803c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:32.322623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1362/2744] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:31 2022] DELETE /identity/v3/users/347470f4732344a7a76a521b29bb803c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:32.327035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.327570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.327759 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.345177 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:32.346358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:32.405443 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1383/2745] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:32.415630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.417552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:32.485261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7b6bd-f4ad-4c88-b506-e1d455de1b59 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.490026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.490996 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.491431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.491719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.502126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.503664 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:32.513761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1363/2746] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:32.817808 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:32.819276 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:32.832171 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606b458-d6ad-442f-b8f1-b6c76fae8eb2 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:32.836895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:32.838356 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:32.838667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:32.838949 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] PATH_INFO: `/v3/users/a50fb6049247411e887d0875b2124b81` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:32.840296 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50fb6049247411e887d0875b2124b81)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:32.842260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.078358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50fb6049247411e887d0875b2124b81'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.079032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50fb6049247411e887d0875b2124b81'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.079661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50fb6049247411e887d0875b2124b81'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.092516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50fb6049247411e887d0875b2124b81'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.099482 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-fc91329d-3d9a-4a99-89dd-6801f93fa20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50fb6049247411e887d0875b2124b81'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.186538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.188015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:33.202406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637c8b-cd45-4514-b6e6-ac2690e915f5 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.205247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1384/2747] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:32 2022] DELETE /identity/v3/users/a50fb6049247411e887d0875b2124b81 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:33.206717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.207010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.207324 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.225621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:33.226883 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:33.233633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.266608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.267599 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.267891 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.268166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] PATH_INFO: `/v3/projects/88b2957cf70c4ba6b18865ead09a8b4a` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.269412 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b2957cf70c4ba6b18865ead09a8b4a)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.271343 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.301039 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1385/2748] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:33.311247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.312591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:33.369013 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b5e0-3798-43fa-b154-a49ca411317a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.372868 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.373516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.373799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.374074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.385000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.385821 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b2957cf70c4ba6b18865ead09a8b4a', 'request_id': 'req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.386788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:33.392245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b2957cf70c4ba6b18865ead09a8b4a', 'request_id': 'req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.394597 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:33.396795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1386/2749] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:26:33.399300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b2957cf70c4ba6b18865ead09a8b4a', 'request_id': 'req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.469659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] The token cache is being invalidate because project 88b2957cf70c4ba6b18865ead09a8b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:33.470048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.470756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:33.472614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1364/2750] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:33 2022] DELETE /identity/v3/projects/88b2957cf70c4ba6b18865ead09a8b4a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:33.905758 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:33.907325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:33.922339 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cfc26-e975-4bda-8152-6f347fce4231 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:33.983738 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:33.984621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:33.984920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:33.985180 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] PATH_INFO: `/v3/projects/08900872db7f4f41bb9509e9baeff66b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:33.986383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08900872db7f4f41bb9509e9baeff66b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:33.988370 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.117137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08900872db7f4f41bb9509e9baeff66b', 'request_id': 'req-eab20b6d-6ca4-4a45-8453-116f8f53eb90'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.121269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:34.196508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08900872db7f4f41bb9509e9baeff66b', 'request_id': 'req-eab20b6d-6ca4-4a45-8453-116f8f53eb90'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.203699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08900872db7f4f41bb9509e9baeff66b', 'request_id': 'req-eab20b6d-6ca4-4a45-8453-116f8f53eb90'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.213960 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] The token cache is being invalidate because project 08900872db7f4f41bb9509e9baeff66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:34.214246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.214859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.216382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1387/2751] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:33 2022] DELETE /identity/v3/projects/08900872db7f4f41bb9509e9baeff66b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:34.220411 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.221920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:34.235594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554487-f2d0-4843-b39b-6fe7ea95dd2d admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:34.294964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:34.296103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:34.296418 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:34.296702 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] PATH_INFO: `/v3/users/db73b912d6fa4284aad3894e78d3d966` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:34.297935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db73b912d6fa4284aad3894e78d3d966)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:34.299999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:34.472719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db73b912d6fa4284aad3894e78d3d966'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.539268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db73b912d6fa4284aad3894e78d3d966'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.539908 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db73b912d6fa4284aad3894e78d3d966'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.553332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db73b912d6fa4284aad3894e78d3d966'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.560889 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-3dffebe3-52d6-4a8e-b583-a0a6a2d3d2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db73b912d6fa4284aad3894e78d3d966'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:34.566831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1365/2752] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:34 2022] DELETE /identity/v3/users/db73b912d6fa4284aad3894e78d3d966 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:34.939351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:34.940812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:34.957687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20b6d-6ca4-4a45-8453-116f8f53eb90 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.015274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.016134 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.016454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.016732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] PATH_INFO: `/v3/projects/f231773d32434bd689ecbfba78613bde` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.017921 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f231773d32434bd689ecbfba78613bde)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.019891 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.099454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f231773d32434bd689ecbfba78613bde', 'request_id': 'req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:35.144906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f231773d32434bd689ecbfba78613bde', 'request_id': 'req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:35.152015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f231773d32434bd689ecbfba78613bde', 'request_id': 'req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:35.162654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] The token cache is being invalidate because project f231773d32434bd689ecbfba78613bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:35.162939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:35.163633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4aea9415-e3a8-47ad-bbe2-5d64b7d20557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:35.165161 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1388/2753] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:34 2022] DELETE /identity/v3/projects/f231773d32434bd689ecbfba78613bde => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:35.170143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.170437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.170721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.188279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:35.189409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:35.253528 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1366/2754] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:35.263000 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.263343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.263624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.283859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:35.285142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:35.294556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1389/2755] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:35.298846 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.308959 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3cbd-4786-4e08-a6c9-4e1752ed6aea None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.313739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.314409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.314698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.314979 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.315831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:35.316169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.317766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.320368 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:35.337083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1367/2756] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:35.341749 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.361558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f8348-9aeb-40c0-9b63-f9e54057b92b None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.361558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.361558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.361558 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.362069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.362069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.362069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.442643 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1390/2757] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:35 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:35.445108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.456083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb34a-f1da-4551-9186-c76203dfcb52 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.517666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.518349 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.518637 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.518918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.519662 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.521606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.611348 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1368/2758] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:35 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:35.612740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.623435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63488bf6-6d76-412f-9033-3567c223467e admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.628393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.629110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.629406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.629690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.630440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.632200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.645061 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1391/2759] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:35.650631 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.662771 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d129-5c3e-48bd-a068-51c6d02e38c5 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.666159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b253341-b7f3-4e4e-8a46-db1510e51967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.667048 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253341-b7f3-4e4e-8a46-db1510e51967 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.667384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253341-b7f3-4e4e-8a46-db1510e51967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.667814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253341-b7f3-4e4e-8a46-db1510e51967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.668548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b253341-b7f3-4e4e-8a46-db1510e51967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.670141 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b253341-b7f3-4e4e-8a46-db1510e51967 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.680419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1369/2760] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:35.685091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.695613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3717-1867-4390-90a5-1006a8f39100 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.700871 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.701747 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.702030 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.702307 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] PATH_INFO: `/v3/projects/5e8d906bb0ac473e9fad676122101aa5/users/9f420d1ed9154b39be029c30a99c5871/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.717081 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8d906bb0ac473e9fad676122101aa5, user_id=9f420d1ed9154b39be029c30a99c5871, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.719827 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:35.797672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1392/2761] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:35 2022] PUT /identity/v3/projects/5e8d906bb0ac473e9fad676122101aa5/users/9f420d1ed9154b39be029c30a99c5871/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:35.817061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.817061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.817061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.837299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] MFA Rules not processed for user `9f420d1ed9154b39be029c30a99c5871`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:35.838497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:35.904787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1370/2762] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:35.906981 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:35.917658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:35.972130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689a8b-bdaa-4899-94da-ce444f12c472 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:35.980503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:35.981189 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:35.981495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:35.981771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:35.982532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:35.984548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.090034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1393/2763] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:35 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:36.094014 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.105171 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab4ee5-b651-4f9f-bfd5-880491a88db5 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.167457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.168143 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.168430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.168739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.169435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:36.171372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.179871 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:36.289194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1371/2764] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:36 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:36.292912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.303505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121303ea-3e44-4d22-ad9e-638ceb8a75ae admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.308689 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.309364 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.309633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.310034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.310763 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:36.312404 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.323788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1394/2765] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:36.328207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.338442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989ac00-6580-4950-9964-f1833aa099a8 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.343019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.343930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.344219 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.344497 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] PATH_INFO: `/v3/projects/6960ff5ec8ec480ab6782d2a3aec2ced/users/756ef8303d4e457a879cb60bea146d72/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.359297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6960ff5ec8ec480ab6782d2a3aec2ced, user_id=756ef8303d4e457a879cb60bea146d72, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:36.361962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.438838 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1372/2766] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:36 2022] PUT /identity/v3/projects/6960ff5ec8ec480ab6782d2a3aec2ced/users/756ef8303d4e457a879cb60bea146d72/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:36.446023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.456849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73617a-69ad-4bb5-9db2-361f732d39ce admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.513425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e57a3d-cc0a-41ff-8c09-444930468dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.514181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e57a3d-cc0a-41ff-8c09-444930468dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.514366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e57a3d-cc0a-41ff-8c09-444930468dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.514639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e57a3d-cc0a-41ff-8c09-444930468dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.515401 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e57a3d-cc0a-41ff-8c09-444930468dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:36.516984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e57a3d-cc0a-41ff-8c09-444930468dc4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.527163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1395/2767] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:36.531152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.542156 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d748fe-0625-4c1a-9c86-80de8ebe7bec admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.546685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.547594 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.547884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.548163 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] PATH_INFO: `/v3/projects/6960ff5ec8ec480ab6782d2a3aec2ced/users/756ef8303d4e457a879cb60bea146d72/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.550155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6960ff5ec8ec480ab6782d2a3aec2ced, user_id=756ef8303d4e457a879cb60bea146d72, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:36.552870 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.563769 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1373/2768] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:36 2022] PUT /identity/v3/projects/6960ff5ec8ec480ab6782d2a3aec2ced/users/756ef8303d4e457a879cb60bea146d72/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:36.574885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.575289 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.575646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.602397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] MFA Rules not processed for user `756ef8303d4e457a879cb60bea146d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:36.604313 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:36.673215 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1396/2769] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:36.685319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.687011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:36.745419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cd896-bb44-4f70-bf3c-75ae7d878370 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.749120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.752385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.752385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.752385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.760289 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:36.761717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:36.771568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1374/2770] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:36.922415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:36.922415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:36.932102 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:36.936036 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5771a-79f3-47f0-a1e7-98b5187dacdd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:36.939666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25897647-4e02-4e12-8f7b-99e5b5359b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:36.940320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25897647-4e02-4e12-8f7b-99e5b5359b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:36.940597 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25897647-4e02-4e12-8f7b-99e5b5359b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:36.940878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25897647-4e02-4e12-8f7b-99e5b5359b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:36.998716 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25897647-4e02-4e12-8f7b-99e5b5359b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:37.000363 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25897647-4e02-4e12-8f7b-99e5b5359b5c service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:37.010309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1397/2771] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:37.453095 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:37.520641 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837826d-ee60-40cb-ae0d-685763349954 service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:37.525275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:37.526150 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.526437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.526717 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] PATH_INFO: `/v3/users/9f420d1ed9154b39be029c30a99c5871` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.527943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f420d1ed9154b39be029c30a99c5871)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:37.529853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:37.695861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f420d1ed9154b39be029c30a99c5871'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:37.738735 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f420d1ed9154b39be029c30a99c5871'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:37.739436 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f420d1ed9154b39be029c30a99c5871'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:37.745355 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:37.752602 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f420d1ed9154b39be029c30a99c5871'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:37.759593 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f420d1ed9154b39be029c30a99c5871'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:37.773308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1375/2772] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:37 2022] DELETE /identity/v3/users/9f420d1ed9154b39be029c30a99c5871 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:37.777088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.777384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.777680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.798101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:37.799389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:37.858163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1398/2773] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:37.867892 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:37.869301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:37.931899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea361-219e-49cb-be89-bc1980441cdb admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:37.935746 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:37.936508 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:37.936845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:37.937129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:37.947464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:37.948973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:37.963003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1376/2774] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:38.324163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.325928 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:38.339403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91e2b-3594-431c-b7c4-9dfe05dc96ab None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.344495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.346142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.346555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.349007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] PATH_INFO: `/v3/projects/5e8d906bb0ac473e9fad676122101aa5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.349007 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8d906bb0ac473e9fad676122101aa5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.350302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.482104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8d906bb0ac473e9fad676122101aa5', 'request_id': 'req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.561816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8d906bb0ac473e9fad676122101aa5', 'request_id': 'req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.568504 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8d906bb0ac473e9fad676122101aa5', 'request_id': 'req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.579327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] The token cache is being invalidate because project 5e8d906bb0ac473e9fad676122101aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:38.579614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.580241 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.581761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1399/2775] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:38 2022] DELETE /identity/v3/projects/5e8d906bb0ac473e9fad676122101aa5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:38.585835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:38.595898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c147b92-98e3-40bf-94a4-f803e59b48b1 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:38.649900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:38.651369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:38.651653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:38.651932 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] PATH_INFO: `/v3/users/756ef8303d4e457a879cb60bea146d72` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:38.653102 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] RBAC: Authorizing `identity:delete_user(user_id=756ef8303d4e457a879cb60bea146d72)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:38.654994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:38.867256 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756ef8303d4e457a879cb60bea146d72'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.927653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756ef8303d4e457a879cb60bea146d72'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.928276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756ef8303d4e457a879cb60bea146d72'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.941780 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756ef8303d4e457a879cb60bea146d72'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.948739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-fc4c74ec-b1b9-4e83-85ea-7c447acd548e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756ef8303d4e457a879cb60bea146d72'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:38.955465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:38.959993 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1377/2776] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:38 2022] DELETE /identity/v3/users/756ef8303d4e457a879cb60bea146d72 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:39.369853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.371393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:39.385406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254dc75-3df2-4b4d-9fc7-31d7aaa8c87c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.411212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:39.443698 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.444621 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.444914 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.445247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] PATH_INFO: `/v3/projects/6960ff5ec8ec480ab6782d2a3aec2ced` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.446516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6960ff5ec8ec480ab6782d2a3aec2ced)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.448615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.556476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6960ff5ec8ec480ab6782d2a3aec2ced', 'request_id': 'req-46c8e1df-0d16-47c9-974b-232821323c66'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:39.613052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6960ff5ec8ec480ab6782d2a3aec2ced', 'request_id': 'req-46c8e1df-0d16-47c9-974b-232821323c66'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:39.619865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6960ff5ec8ec480ab6782d2a3aec2ced', 'request_id': 'req-46c8e1df-0d16-47c9-974b-232821323c66'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:39.632025 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] The token cache is being invalidate because project 6960ff5ec8ec480ab6782d2a3aec2ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:39.632254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:39.632888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-46c8e1df-0d16-47c9-974b-232821323c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:39.634429 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1400/2777] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:39 2022] DELETE /identity/v3/projects/6960ff5ec8ec480ab6782d2a3aec2ced => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:39.639988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.640486 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.640630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.661287 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:39.662558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:39.721437 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1378/2778] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:39.729451 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.729745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.730028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.748879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:39.750084 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:39.757982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1401/2779] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:39.762651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.772801 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6cb9f-2a18-4e36-a74a-6d0bbd46306a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.780200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.780878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.781166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.781530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.782482 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:39.782799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.784453 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.798073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1379/2780] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:39.802561 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.812919 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72ce15-d578-47a4-ba90-2ff6af02de01 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.818595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.819501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.819912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.820184 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.820875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.822776 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:39.901093 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1402/2781] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:39.905385 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:39.915756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04b6ae-b7b9-499c-94fc-f23a28e1b1d2 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:39.973760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:39.974433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:39.974839 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:39.975147 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:39.975883 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:39.977794 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:40.036485 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1380/2782] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:39 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:40.040359 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:40.050691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954164a-4163-4b01-bd0d-e385616b311f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:40.055299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:40.055951 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:40.056234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:40.057008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:40.057730 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:40.059350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:40.069368 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1403/2783] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:40.078946 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:40.092073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e81a-e025-4065-b7be-5e57af230103 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:40.098260 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97843eb5-99be-4370-9e06-c8b3e1b1f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:40.098935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97843eb5-99be-4370-9e06-c8b3e1b1f10d admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:40.099276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97843eb5-99be-4370-9e06-c8b3e1b1f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:40.099562 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97843eb5-99be-4370-9e06-c8b3e1b1f10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:40.100299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97843eb5-99be-4370-9e06-c8b3e1b1f10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:40.102026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97843eb5-99be-4370-9e06-c8b3e1b1f10d admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:40.112596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1381/2784] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:40.116484 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:40.129042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67f840-44d7-4735-b8d7-241f94793e2b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:40.133591 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:40.134463 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:40.135377 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:40.135658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] PATH_INFO: `/v3/projects/591fad6d252e42de8ec7b225685d7494/users/c3f79d49233b44f1a799183b06219f6a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:40.149760 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591fad6d252e42de8ec7b225685d7494, user_id=c3f79d49233b44f1a799183b06219f6a, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:40.152553 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:40.242286 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1404/2785] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:40 2022] PUT /identity/v3/projects/591fad6d252e42de8ec7b225685d7494/users/c3f79d49233b44f1a799183b06219f6a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:40.253178 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:40.253553 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:40.253835 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:40.282082 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] MFA Rules not processed for user `c3f79d49233b44f1a799183b06219f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:40.283352 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:40.338530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:40.347138 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1382/2786] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:40.358773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:40.360491 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:40.421053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52be5-8438-4941-9026-e84b8ba38105 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:40.426379 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dc35c-7b18-4388-8f4e-f1246968ac4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:40.427038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dc35c-7b18-4388-8f4e-f1246968ac4a service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:40.427353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dc35c-7b18-4388-8f4e-f1246968ac4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:40.427634 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dc35c-7b18-4388-8f4e-f1246968ac4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:40.437179 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:40.439528 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dc35c-7b18-4388-8f4e-f1246968ac4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:40.441010 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dc35c-7b18-4388-8f4e-f1246968ac4a service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:40.451294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1405/2787] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:41.556361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:41.557790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:41.621022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11aca3-f182-4434-842d-ba937db641a8 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:41.625845 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:41.626766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.627047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.627342 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] PATH_INFO: `/v3/users/8baacb519ca04fb19366d5027f276833` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.628580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baacb519ca04fb19366d5027f276833)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:41.630484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:41.808180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baacb519ca04fb19366d5027f276833'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:41.874841 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baacb519ca04fb19366d5027f276833'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:41.875461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baacb519ca04fb19366d5027f276833'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:41.887788 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baacb519ca04fb19366d5027f276833'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:41.894694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baacb519ca04fb19366d5027f276833'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:41.900823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1383/2788] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:26:41 2022] DELETE /identity/v3/users/8baacb519ca04fb19366d5027f276833 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:41.905901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:41.906373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:41.906479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:41.923687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:41.924923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:41.982245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1406/2789] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:41.992033 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:41.999267 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:42.055969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38e62-cad5-4848-bcd7-618732adba90 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.060155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fba95-1692-45f5-90d3-8c1635ad3dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.060742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fba95-1692-45f5-90d3-8c1635ad3dde service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.061022 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fba95-1692-45f5-90d3-8c1635ad3dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.061452 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fba95-1692-45f5-90d3-8c1635ad3dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.073561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fba95-1692-45f5-90d3-8c1635ad3dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.076159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fba95-1692-45f5-90d3-8c1635ad3dde service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.091279 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1384/2790] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:42.495281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.497413 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:42.511355 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf396594-2efd-4372-b154-24de83150ff9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.516427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.517471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.517888 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.518052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] PATH_INFO: `/v3/projects/e2e16b4211704ad4aebf12c8cce8c13a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.519269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e16b4211704ad4aebf12c8cce8c13a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.521287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.625208 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e16b4211704ad4aebf12c8cce8c13a', 'request_id': 'req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:42.699462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e16b4211704ad4aebf12c8cce8c13a', 'request_id': 'req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:42.706250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e16b4211704ad4aebf12c8cce8c13a', 'request_id': 'req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:42.717557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] The token cache is being invalidate because project e2e16b4211704ad4aebf12c8cce8c13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:26:42.717846 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:42.718477 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-9f7d4959-cad4-44ce-a651-0676d0a8b1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:26:42.720069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1407/2791] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:26:42 2022] DELETE /identity/v3/projects/e2e16b4211704ad4aebf12c8cce8c13a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:42.725456 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.726041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.726041 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.744285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:42.745479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:42.757394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:42.804730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1385/2792] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:42.812876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.813162 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.813441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.832381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:42.833507 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:42.841514 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1408/2793] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:42.845580 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.855676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18387399-c7ac-4d89-b9bb-aae26364a93e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.860548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.862079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.862079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.862079 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.862552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:26:42.862864 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.864498 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.876737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1386/2794] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:26:42.880462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.890043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff1b6-9a22-4043-8443-9e3c0acbe714 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:42.894613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:42.895290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:42.895576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:42.895852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:42.896573 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:42.898481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:42.967940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1409/2795] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:26:42 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:26:42.972060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:42.982054 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980f0f-bf88-4906-9b52-ea1c359ab844 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.037169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.037843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.038129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.038413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.039126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.041034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.137435 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1387/2796] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:26:42 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:26:43.138872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.149402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8e19a-be07-469c-8c2a-66e4dadb5fc2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.162385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.162385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.162385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.162385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.162704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.162704 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.173263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1410/2797] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:43.177215 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.187800 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ada7a2-729a-4462-83c2-9f9c531a9481 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.192361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34849-c755-4d12-8c52-a2daacf618b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.193009 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34849-c755-4d12-8c52-a2daacf618b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.193292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34849-c755-4d12-8c52-a2daacf618b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.193568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34849-c755-4d12-8c52-a2daacf618b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.194291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34849-c755-4d12-8c52-a2daacf618b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.195928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34849-c755-4d12-8c52-a2daacf618b7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.206199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1388/2798] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:26:43.210042 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.220415 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453f36-c126-4a8f-95f7-cf5a8aedb086 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.225746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.226622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.226906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.227336 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] PATH_INFO: `/v3/projects/dc1b224fe30046818ae82965e9a342a4/users/e1294970af9b42f7b2144975469ac69e/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.242579 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1b224fe30046818ae82965e9a342a4, user_id=e1294970af9b42f7b2144975469ac69e, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.245302 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.316651 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1411/2799] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:26:43 2022] PUT /identity/v3/projects/dc1b224fe30046818ae82965e9a342a4/users/e1294970af9b42f7b2144975469ac69e/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:26:43.327484 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.327781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.328061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.355805 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] MFA Rules not processed for user `e1294970af9b42f7b2144975469ac69e`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:26:43.357016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:43.419855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1389/2800] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:26:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:26:43.430265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:26:43.431939 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:26:43.451108 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:43.488654 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6c2b-60b7-450d-8225-cfeda0cb5db4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:26:43.492604 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4032f-b7a5-48c9-a2ca-58034035e2f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:26:43.493242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4032f-b7a5-48c9-a2ca-58034035e2f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:26:43.493526 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4032f-b7a5-48c9-a2ca-58034035e2f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:26:43.493802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4032f-b7a5-48c9-a2ca-58034035e2f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:26:43.502449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4032f-b7a5-48c9-a2ca-58034035e2f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:26:43.503953 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4032f-b7a5-48c9-a2ca-58034035e2f6 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:26:43.512556 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1412/2801] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:26:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:26:53.416293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:26:53.556321 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=19 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:19.477853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.479332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:19.546262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef7d4d-e1bc-4ae9-8572-087376f5789d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.550927 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.551831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.552114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.552443 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] PATH_INFO: `/v3/users/c3f79d49233b44f1a799183b06219f6a` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.553585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f79d49233b44f1a799183b06219f6a)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.555732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.711447 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f79d49233b44f1a799183b06219f6a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:19.761114 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f79d49233b44f1a799183b06219f6a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:19.761820 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f79d49233b44f1a799183b06219f6a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:19.774802 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f79d49233b44f1a799183b06219f6a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:19.781565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f79d49233b44f1a799183b06219f6a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:19.787714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1390/2802] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:27:19 2022] DELETE /identity/v3/users/c3f79d49233b44f1a799183b06219f6a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:19.792165 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.792652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.792744 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.809358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:19.811121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:19.870372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1413/2803] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:19.880840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:19.882227 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:19.938003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6d6b-8c70-4ef3-956d-99b017f0b467 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:19.941635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303106c-8cff-40f3-902a-13cfc841de92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:19.942277 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303106c-8cff-40f3-902a-13cfc841de92 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:19.942557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303106c-8cff-40f3-902a-13cfc841de92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:19.942834 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303106c-8cff-40f3-902a-13cfc841de92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:19.952234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303106c-8cff-40f3-902a-13cfc841de92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:19.953643 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303106c-8cff-40f3-902a-13cfc841de92 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:19.963230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1391/2804] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:27:20.317690 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.318733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:20.336559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e3ea-3584-40e7-998e-d57f8160e11a None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.347875 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.348876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.349159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.349455 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] PATH_INFO: `/v3/projects/591fad6d252e42de8ec7b225685d7494` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.350657 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591fad6d252e42de8ec7b225685d7494)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.352696 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.441550 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591fad6d252e42de8ec7b225685d7494', 'request_id': 'req-a14ec05e-5594-4815-bc95-2eab328932b3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:20.481245 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591fad6d252e42de8ec7b225685d7494', 'request_id': 'req-a14ec05e-5594-4815-bc95-2eab328932b3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:20.488060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591fad6d252e42de8ec7b225685d7494', 'request_id': 'req-a14ec05e-5594-4815-bc95-2eab328932b3'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:20.498138 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] The token cache is being invalidate because project 591fad6d252e42de8ec7b225685d7494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:27:20.498449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:20.499065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-a14ec05e-5594-4815-bc95-2eab328932b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:20.500622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1414/2805] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:27:20 2022] DELETE /identity/v3/projects/591fad6d252e42de8ec7b225685d7494 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:20.505687 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.506142 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.506258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.526847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:20.528168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:20.547231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:20.588461 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1392/2806] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:20.596838 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.597133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.597414 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.615218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:20.616447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:20.624178 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1415/2807] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:20.628329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.638585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaea86-9b26-48c0-b8ec-0c5fe0544707 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.643439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.644160 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.644480 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.644779 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.645511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:27:20.645826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.647884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.662473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1393/2808] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:27:20.666839 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.676218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a224ad9-7167-42d2-af14-be40a43073f8 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.680886 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.682388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.682388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.682388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.682742 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.684829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.751024 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1416/2809] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:27:20 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:20.755089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.766545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ee61-d29a-49ae-aeb8-797a3a2e67d0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.821255 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.822006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.822293 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.822603 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.823419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.825319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.898685 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1394/2810] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:27:20 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:20.902635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.913088 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2f6e-1a8a-4d48-aafc-1fcfa5d608b1 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.917693 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.918343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.918626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.918902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.920254 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.921851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.932255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1417/2811] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:20.936645 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.946386 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414bf40-7bfd-4652-b588-430e83ce826a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.951545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd42af7-aae3-46e1-b409-69c4960739d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.952187 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42af7-aae3-46e1-b409-69c4960739d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.952471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42af7-aae3-46e1-b409-69c4960739d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.952747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42af7-aae3-46e1-b409-69c4960739d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:20.953464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd42af7-aae3-46e1-b409-69c4960739d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:20.955110 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd42af7-aae3-46e1-b409-69c4960739d7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:20.964874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1395/2812] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:20.969394 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:20.979251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b6a69-4b12-48a4-bf84-e84ca4e5e223 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:20.983802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:20.984677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:20.984961 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:20.985238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] PATH_INFO: `/v3/projects/e3fdaf46b0cf4f4dbe325da03d14aefd/users/257a3c3bdc0348daad32781e63ccd202/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.001144 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fdaf46b0cf4f4dbe325da03d14aefd, user_id=257a3c3bdc0348daad32781e63ccd202, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.004460 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.104524 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1418/2813] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:27:20 2022] PUT /identity/v3/projects/e3fdaf46b0cf4f4dbe325da03d14aefd/users/257a3c3bdc0348daad32781e63ccd202/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:21.115237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.115536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.115847 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.141248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] MFA Rules not processed for user `257a3c3bdc0348daad32781e63ccd202`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:21.142442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:21.205016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1396/2814] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:21.209564 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.230261 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.270713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791b26f-8172-43db-ad6b-06415a92ed8f admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.275279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.275962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.276242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.279568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.279568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.279735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.406894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1419/2815] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:27:21 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:21.409559 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.421861 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114cba-aa29-4d0e-999c-1223f57b059a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.434308 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:21.477036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.477706 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.477989 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.478262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.478941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.480917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.578298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1397/2816] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:27:21 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:21.579518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.590538 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4e39-741f-472a-8fb5-a400d0757da0 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.596047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.596719 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.597012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.597290 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.598012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.599691 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.610539 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1420/2817] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:21.614446 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.624591 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56fd9a-cebe-4bd3-ab84-4e0af8f304d3 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.629161 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23e40b-5e35-4b84-8478-1229c88e8680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.629817 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e40b-5e35-4b84-8478-1229c88e8680 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.630103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e40b-5e35-4b84-8478-1229c88e8680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.630384 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e40b-5e35-4b84-8478-1229c88e8680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.631120 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e40b-5e35-4b84-8478-1229c88e8680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.632718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e40b-5e35-4b84-8478-1229c88e8680 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.643268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1398/2818] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:21.647242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.658076 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41b25-2d60-4fed-a043-daca177589f2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.663268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.664146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.664435 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.664713 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] PATH_INFO: `/v3/projects/8d5045ab8a9f4e56b5bc64136a2e6805/users/1ac4bb91b1e44fd3bab75dd472d31a99/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.679251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5045ab8a9f4e56b5bc64136a2e6805, user_id=1ac4bb91b1e44fd3bab75dd472d31a99, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.681915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:21.755385 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1421/2819] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:27:21 2022] PUT /identity/v3/projects/8d5045ab8a9f4e56b5bc64136a2e6805/users/1ac4bb91b1e44fd3bab75dd472d31a99/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:21.766917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.767250 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.767538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.794947 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] MFA Rules not processed for user `1ac4bb91b1e44fd3bab75dd472d31a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:21.796200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:21.860667 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1399/2820] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:21.865104 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:21.926503 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b5e38-17f7-46b4-81f3-daccf2313132 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:21.931118 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:21.931825 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:21.932109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:21.932384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:21.933072 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:21.935204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.021527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1422/2821] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:27:21 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:22.026172 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.040895 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382deb-c0ca-472c-a27f-e1b401da4659 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.098259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.098943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.099257 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.099537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.100231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.102155 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.195770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1400/2822] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:27:22 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:27:22.203667 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.214047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356e5b-a2a7-4ab6-b530-a938be8cb32b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.219353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.220004 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.220291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.220589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.221297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.222924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.234269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1423/2823] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:22.238911 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.249312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd4e6-6a9f-4031-b99c-577dbeb9c498 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.253948 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.254827 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.255136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.255425 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] PATH_INFO: `/v3/projects/9b87fc539e3948e580256828d76afba1/users/e18fea1cef04401f92385aa951ab8848/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.267756 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:22.270682 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b87fc539e3948e580256828d76afba1, user_id=e18fea1cef04401f92385aa951ab8848, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.273353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.344261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1401/2824] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:27:22 2022] PUT /identity/v3/projects/9b87fc539e3948e580256828d76afba1/users/e18fea1cef04401f92385aa951ab8848/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:27:22.348219 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.358111 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767bb2-e2c0-4452-b95a-99bc771a4eff admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.405637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:22.421060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c987ac-522b-4cbf-a107-c7695d46a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.421732 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c987ac-522b-4cbf-a107-c7695d46a510 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.422112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c987ac-522b-4cbf-a107-c7695d46a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.422397 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c987ac-522b-4cbf-a107-c7695d46a510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.423159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c987ac-522b-4cbf-a107-c7695d46a510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.424774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c987ac-522b-4cbf-a107-c7695d46a510 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.435259 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1424/2825] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:27:22.439505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.449899 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d3c4-96b8-463c-9a7c-0297742ccdf8 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.455008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.455918 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.456208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.456492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] PATH_INFO: `/v3/projects/9b87fc539e3948e580256828d76afba1/users/e18fea1cef04401f92385aa951ab8848/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.458530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b87fc539e3948e580256828d76afba1, user_id=e18fea1cef04401f92385aa951ab8848, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.461197 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.471855 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1402/2826] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:27:22 2022] PUT /identity/v3/projects/9b87fc539e3948e580256828d76afba1/users/e18fea1cef04401f92385aa951ab8848/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:22.481741 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213fa4-3482-43e4-995c-f516747271db None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.482066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213fa4-3482-43e4-995c-f516747271db None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.482374 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25213fa4-3482-43e4-995c-f516747271db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.508365 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-25213fa4-3482-43e4-995c-f516747271db None None] MFA Rules not processed for user `e18fea1cef04401f92385aa951ab8848`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:22.509568 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-25213fa4-3482-43e4-995c-f516747271db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:22.575255 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1425/2827] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:22.586903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.588629 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:22.626427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213fa4-3482-43e4-995c-f516747271db None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:22.627884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-25213fa4-3482-43e4-995c-f516747271db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:22.646917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74962854-9a42-4121-ac09-82ee8e64cf6c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.650624 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278001d-9d55-4307-bde2-89d58a6e04bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.651299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278001d-9d55-4307-bde2-89d58a6e04bc service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.651592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278001d-9d55-4307-bde2-89d58a6e04bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.651878 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278001d-9d55-4307-bde2-89d58a6e04bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.696357 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25213fa4-3482-43e4-995c-f516747271db None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:22.701853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:22.702723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:22.703009 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:22.703320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] PATH_INFO: `/v3/users/e1294970af9b42f7b2144975469ac69e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:22.704533 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1294970af9b42f7b2144975469ac69e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.706493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.708964 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278001d-9d55-4307-bde2-89d58a6e04bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:22.710394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278001d-9d55-4307-bde2-89d58a6e04bc service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:22.719500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1403/2828] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:27:22.894389 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1294970af9b42f7b2144975469ac69e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:22.895063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1294970af9b42f7b2144975469ac69e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:22.895723 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1294970af9b42f7b2144975469ac69e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:22.907496 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1294970af9b42f7b2144975469ac69e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:22.909595 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:22.915027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1294970af9b42f7b2144975469ac69e'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:23.006983 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1426/2829] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:27:22 2022] DELETE /identity/v3/users/e1294970af9b42f7b2144975469ac69e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:23.011727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:23.012024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:23.012312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:23.030431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:23.031666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:23.090433 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1404/2830] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:23.100248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:23.101661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:23.174810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31479e-c458-4aef-8820-6642ecb159eb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:23.174810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:23.174810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:23.174810 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:23.175181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:23.179818 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:23.181265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:23.191532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1427/2831] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:27:23.609167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:23.610704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:23.623840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c395c5d-3d0f-45ba-be81-9cc326827ddb None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:23.629442 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:23.635867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:23.635867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:23.635867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] PATH_INFO: `/v3/projects/dc1b224fe30046818ae82965e9a342a4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:23.635867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1b224fe30046818ae82965e9a342a4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:23.635867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:23.711721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:23.726505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1b224fe30046818ae82965e9a342a4', 'request_id': 'req-6ddca031-305c-4384-8923-dff1ae906036'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:23.731876 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1b224fe30046818ae82965e9a342a4', 'request_id': 'req-6ddca031-305c-4384-8923-dff1ae906036'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:23.737867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1b224fe30046818ae82965e9a342a4', 'request_id': 'req-6ddca031-305c-4384-8923-dff1ae906036'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:23.794057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] The token cache is being invalidate because project dc1b224fe30046818ae82965e9a342a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:27:23.794337 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:23.795070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:23.797136 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1405/2832] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:27:23 2022] DELETE /identity/v3/projects/dc1b224fe30046818ae82965e9a342a4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:24.677932 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:24.679341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:24.735060 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d00af-a3b8-4e03-8604-f60590342873 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:24.789372 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:24.790027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:24.790312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:24.790618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:24.792469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:24.863901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:24.865535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:24.869049 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:24.876016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1428/2833] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:27:26.166471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:26.167951 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:26.180026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca031-305c-4384-8923-dff1ae906036 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:26.183565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:26.184199 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:26.184483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:26.184784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:26.186561 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:26.249540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:26.250999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988095c-9bc0-40c2-85fc-eac5144ec0fe service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:26.260518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1406/2834] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:27:30.702048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:30.703478 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:30.770812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879306c6-91eb-4d41-9c9e-6850e8c50892 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:30.771070 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:30.772096 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:30.772383 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:30.772658 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] PATH_INFO: `/v3/users/257a3c3bdc0348daad32781e63ccd202` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:30.773837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257a3c3bdc0348daad32781e63ccd202)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:30.775800 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:30.939373 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257a3c3bdc0348daad32781e63ccd202'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:30.940038 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257a3c3bdc0348daad32781e63ccd202'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:30.940633 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257a3c3bdc0348daad32781e63ccd202'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:30.952715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257a3c3bdc0348daad32781e63ccd202'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:30.960639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257a3c3bdc0348daad32781e63ccd202'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.011884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1429/2835] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:27:30 2022] DELETE /identity/v3/users/257a3c3bdc0348daad32781e63ccd202 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:31.016467 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.018842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.018842 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.035025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:27:31.036176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:31.093375 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1407/2836] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:27:31.103022 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.104492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:31.161452 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbf04-d72c-41ab-b30a-874acef634f2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.165346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.165965 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.166247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.166521 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.175271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.176706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.185853 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1430/2837] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:27:31.592523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.594011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:31.606339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d28c1f-203a-4a14-8086-deabfe854c0d None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.611630 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.612810 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.613100 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.613376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] PATH_INFO: `/v3/projects/e3fdaf46b0cf4f4dbe325da03d14aefd` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.614620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fdaf46b0cf4f4dbe325da03d14aefd)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.616568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.701068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.704001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fdaf46b0cf4f4dbe325da03d14aefd', 'request_id': 'req-8cdd23b9-0204-469b-8605-8f88461930e6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.709396 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fdaf46b0cf4f4dbe325da03d14aefd', 'request_id': 'req-8cdd23b9-0204-469b-8605-8f88461930e6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.715532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fdaf46b0cf4f4dbe325da03d14aefd', 'request_id': 'req-8cdd23b9-0204-469b-8605-8f88461930e6'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.766103 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] The token cache is being invalidate because project e3fdaf46b0cf4f4dbe325da03d14aefd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:27:31.766392 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.767010 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.768585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1408/2838] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:27:31 2022] DELETE /identity/v3/projects/e3fdaf46b0cf4f4dbe325da03d14aefd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:31.773852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:31.783542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49adf2d-6f92-4778-b794-53bc0a4b1070 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:31.799987 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:31.839501 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:31.840354 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:31.840635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:31.840962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] PATH_INFO: `/v3/users/1ac4bb91b1e44fd3bab75dd472d31a99` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:31.842137 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac4bb91b1e44fd3bab75dd472d31a99)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:31.844101 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:31.963123 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac4bb91b1e44fd3bab75dd472d31a99'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.963703 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac4bb91b1e44fd3bab75dd472d31a99'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.964303 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac4bb91b1e44fd3bab75dd472d31a99'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.976008 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac4bb91b1e44fd3bab75dd472d31a99'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:31.983492 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac4bb91b1e44fd3bab75dd472d31a99'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.040968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1431/2839] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:27:31 2022] DELETE /identity/v3/users/1ac4bb91b1e44fd3bab75dd472d31a99 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:32.425684 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.427188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:32.440353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd23b9-0204-469b-8605-8f88461930e6 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.498094 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.498950 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.499265 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.499544 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] PATH_INFO: `/v3/projects/8d5045ab8a9f4e56b5bc64136a2e6805` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.500730 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5045ab8a9f4e56b5bc64136a2e6805)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.502905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.577925 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5045ab8a9f4e56b5bc64136a2e6805', 'request_id': 'req-a58fed59-e242-4160-b5b5-e02538be0763'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.583431 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5045ab8a9f4e56b5bc64136a2e6805', 'request_id': 'req-a58fed59-e242-4160-b5b5-e02538be0763'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.589459 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5045ab8a9f4e56b5bc64136a2e6805', 'request_id': 'req-a58fed59-e242-4160-b5b5-e02538be0763'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.634234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] The token cache is being invalidate because project 8d5045ab8a9f4e56b5bc64136a2e6805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:27:32.634539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.635165 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.636694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1409/2840] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:27:32 2022] DELETE /identity/v3/projects/8d5045ab8a9f4e56b5bc64136a2e6805 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:32.641047 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:32.642562 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:32.655737 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad267e2-b3fb-4536-a884-a366c314e590 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:32.710809 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:32.711721 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:32.712011 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:32.712291 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] PATH_INFO: `/v3/users/e18fea1cef04401f92385aa951ab8848` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:32.713471 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18fea1cef04401f92385aa951ab8848)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:32.715467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:32.883751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:32.889146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18fea1cef04401f92385aa951ab8848'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.892371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18fea1cef04401f92385aa951ab8848'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.892371 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18fea1cef04401f92385aa951ab8848'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.901948 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18fea1cef04401f92385aa951ab8848'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:32.909240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18fea1cef04401f92385aa951ab8848'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:33.024064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1432/2841] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:27:32 2022] DELETE /identity/v3/users/e18fea1cef04401f92385aa951ab8848 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:33.437401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:33.438913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:33.452012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fed59-e242-4160-b5b5-e02538be0763 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:33.508566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:33.509426 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:33.509709 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:33.509983 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] PATH_INFO: `/v3/projects/9b87fc539e3948e580256828d76afba1` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:33.511176 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b87fc539e3948e580256828d76afba1)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:33.513091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:33.519174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:33.631548 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b87fc539e3948e580256828d76afba1', 'request_id': 'req-987b32ca-73cf-4436-87de-eb666f515d3a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:33.637766 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b87fc539e3948e580256828d76afba1', 'request_id': 'req-987b32ca-73cf-4436-87de-eb666f515d3a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:33.644773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b87fc539e3948e580256828d76afba1', 'request_id': 'req-987b32ca-73cf-4436-87de-eb666f515d3a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:33.760504 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] The token cache is being invalidate because project 9b87fc539e3948e580256828d76afba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:27:33.760797 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:33.761415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:27:33.762978 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1410/2842] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:27:33 2022] DELETE /identity/v3/projects/9b87fc539e3948e580256828d76afba1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:27:34.974378 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:27:34.975821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:35.033050 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a761-0c27-41f9-b383-b7739e2d59ce admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:27:35.081485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:27:35.082127 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:27:35.082406 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:27:35.082680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:27:35.084454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:27:35.093548 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:27:35.094995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:27:35.102795 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1433/2843] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:27:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:27:43.757212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:27:45.099275 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=60,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:30.826008 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:30.827483 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:30.840314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b32ca-73cf-4436-87de-eb666f515d3a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:30.844017 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:30.844659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:30.844945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:30.845405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:30.847047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:30.919123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:30.920565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:30.932025 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1411/2844] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:32.110235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:32.119403 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680e2f-1bf1-41fb-bc0e-fa75aa7012e3 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:32.123023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:32.123701 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:32.123989 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:32.124267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:32.126032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:32.140095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:32.141540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:32.153351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1434/2845] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:32.519500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:32.521738 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:32.536640 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ca649-fb59-4c57-a6e0-fa3269df0d53 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:32.542742 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:32.543438 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:32.543727 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:32.544007 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:32.545942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:32.558830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:32.562271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:32.572663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1412/2846] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:34.846388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:34.884353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63da2e-2bd5-455a-8ad6-6800b23babd5 service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:34.889836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6867f7729ddf465ca6d31df087c00881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:34.890476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:34.890802 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:34.891083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:34.892879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:34.958493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:34.960606 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:34.978916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1435/2847] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:38.538638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:38.540843 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:38.555361 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456025c-9bea-4450-86f5-d3e5b6c97dd3 service nova] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:38.558819 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:38.559489 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:38.559776 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:38.560053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:38.561707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:38.628812 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:38.630241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:38.639920 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1413/2848] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:42.041884 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.043608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:42.113582 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa556cbb-a2ba-466d-a16f-59755910e6af service nova] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.119120 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.119782 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.120063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.120343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.122240 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:42.134660 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.136266 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.146203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1436/2849] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:42.168246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.168246 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:42.178091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8b6b2-3892-402e-9cf4-6dc43b6cd614 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.183903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.184865 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.185217 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.185560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] PATH_INFO: `/v3/users/606ff49786a04aa5b677cbb9a57b216c` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.186886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606ff49786a04aa5b677cbb9a57b216c)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.189166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.344654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606ff49786a04aa5b677cbb9a57b216c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.412144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606ff49786a04aa5b677cbb9a57b216c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.412803 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606ff49786a04aa5b677cbb9a57b216c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.419582 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:42.426670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606ff49786a04aa5b677cbb9a57b216c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.434087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-bc0df5f9-458a-4c85-b63a-220dbfac1e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606ff49786a04aa5b677cbb9a57b216c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.440191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1414/2850] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:28:42 2022] DELETE /identity/v3/users/606ff49786a04aa5b677cbb9a57b216c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:28:42.706272 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:42.718326 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0725-50b0-4432-841d-f8ee89557147 service placement] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:42.756187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:42.786816 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:42.787720 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.788312 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.793229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] PATH_INFO: `/v3/projects/ad4a74e93cb54747a64778b2dbea9da8` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:42.793229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4a74e93cb54747a64778b2dbea9da8)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:42.793229 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:42.891906 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4a74e93cb54747a64778b2dbea9da8', 'request_id': 'req-4283458b-63d7-4f2b-b291-21914f9405c6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.960388 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4a74e93cb54747a64778b2dbea9da8', 'request_id': 'req-4283458b-63d7-4f2b-b291-21914f9405c6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.967297 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4a74e93cb54747a64778b2dbea9da8', 'request_id': 'req-4283458b-63d7-4f2b-b291-21914f9405c6'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.978271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] The token cache is being invalidate because project ad4a74e93cb54747a64778b2dbea9da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:28:42.978555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.979212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4283458b-63d7-4f2b-b291-21914f9405c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:28:42.980831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1437/2851] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:28:42 2022] DELETE /identity/v3/projects/ad4a74e93cb54747a64778b2dbea9da8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:28:42.991939 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:42.992168 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:42.992505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.010511 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:43.011759 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:43.076585 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1415/2852] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:28:43.084904 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.085481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.085481 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.105909 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:43.107147 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:43.115508 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1438/2853] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:28:43.120070 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.129753 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef8e71-5bf8-4117-a5ef-0fc3f957bed9 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.137898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.137898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.137898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.137898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.138237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:28:43.138237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.138237 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.150126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1416/2854] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:28:43.154462 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.163867 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad1da0-cef3-4e99-a8d9-49ca63d55be9 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.169019 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.172191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.172191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.172191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.172191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.172819 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.260494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1439/2855] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:28:43 2022] POST /identity/v3/projects => generated 353 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:43.269767 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.280297 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274f7a-03f7-40df-bb02-f9623dca998b admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.334936 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.335635 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.335957 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.337434 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.337552 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.339502 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.418248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1417/2856] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:28:43 2022] POST /identity/v3/users => generated 277 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:28:43.423635 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.434032 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259cce-dc93-4801-9c2d-f2df58e14dac admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.438866 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.439570 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.439852 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.440125 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.440849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.442474 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.453575 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1440/2857] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:28:43.457399 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.467859 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734d57-f96c-4adc-9ed8-5f44e336e413 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.472370 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f7556-6ced-4737-8136-3256fdd85a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.473016 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f7556-6ced-4737-8136-3256fdd85a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.473298 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f7556-6ced-4737-8136-3256fdd85a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.473576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f7556-6ced-4737-8136-3256fdd85a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.474296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f7556-6ced-4737-8136-3256fdd85a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.475930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f7556-6ced-4737-8136-3256fdd85a17 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.485521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1418/2858] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:28:43.489345 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.499195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2cbf-e0d4-466b-a2af-3f6f2ebd1fcc admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.503858 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.504729 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.505016 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.505298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] PATH_INFO: `/v3/projects/6d17c17a8aca4fb099f0ef563bd37fa5/users/4cc443b4d9344ea49da0cc112e3ecbc4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.520159 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d17c17a8aca4fb099f0ef563bd37fa5, user_id=4cc443b4d9344ea49da0cc112e3ecbc4, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.522745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.578407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1441/2859] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:28:43 2022] PUT /identity/v3/projects/6d17c17a8aca4fb099f0ef563bd37fa5/users/4cc443b4d9344ea49da0cc112e3ecbc4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:28:43.589180 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.589472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.589751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.615837 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] MFA Rules not processed for user `4cc443b4d9344ea49da0cc112e3ecbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:43.617071 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:43.653451 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:43.693784 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1419/2860] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:28:43.698911 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.757027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:43.760649 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb1a8-aeea-47d5-a398-ce33b78f9bfe admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.774263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.774263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.774263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.774263 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.774652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.774652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.859755 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1442/2861] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:28:43 2022] POST /identity/v3/projects => generated 355 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:43.864026 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.874790 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6b85-b1cf-45c7-8e93-f943ec49473a None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:43.929879 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:43.930539 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:43.930825 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:43.931123 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:43.931894 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:43.933822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:43.984241 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1420/2862] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:28:43 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:28:43.988343 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:43.998831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464059b-f0cd-48eb-8117-8cbc52f9272c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:44.003652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:44.004299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.004586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.004890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.005608 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:44.007335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:44.021792 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1443/2863] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:28:44.032464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:44.036312 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761add5-83af-4fe6-8d0e-cc1ea53a631e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:44.041152 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:44.042021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.042303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.042581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] PATH_INFO: `/v3/projects/cd68ea9c7eae4290af2d9d76c8ccc0f7/users/3e1b8c68b2f0435ebe3672af04353bb3/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.056840 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd68ea9c7eae4290af2d9d76c8ccc0f7, user_id=3e1b8c68b2f0435ebe3672af04353bb3, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:44.059560 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:44.138376 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1421/2864] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:28:44 2022] PUT /identity/v3/projects/cd68ea9c7eae4290af2d9d76c8ccc0f7/users/3e1b8c68b2f0435ebe3672af04353bb3/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:28:44.142351 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:44.153066 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7a8c-c74d-4aa7-9601-a5ccd0a46cfb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:44.208295 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e3c6-7aa2-4c07-b8cf-2ee8c5f904d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:44.208962 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e3c6-7aa2-4c07-b8cf-2ee8c5f904d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.209248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e3c6-7aa2-4c07-b8cf-2ee8c5f904d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.209531 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e3c6-7aa2-4c07-b8cf-2ee8c5f904d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.210253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e3c6-7aa2-4c07-b8cf-2ee8c5f904d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:44.212441 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e3c6-7aa2-4c07-b8cf-2ee8c5f904d8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:44.221890 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1444/2865] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:28:44.226259 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:44.236523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b31b5-e639-48df-8744-e599c86bac55 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:44.241019 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:44.241885 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.242166 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.242477 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] PATH_INFO: `/v3/projects/cd68ea9c7eae4290af2d9d76c8ccc0f7/users/3e1b8c68b2f0435ebe3672af04353bb3/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.244581 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd68ea9c7eae4290af2d9d76c8ccc0f7, user_id=3e1b8c68b2f0435ebe3672af04353bb3, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:44.247208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:44.257276 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1422/2866] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:28:44 2022] PUT /identity/v3/projects/cd68ea9c7eae4290af2d9d76c8ccc0f7/users/3e1b8c68b2f0435ebe3672af04353bb3/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:28:44.267733 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.268026 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.268308 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.296353 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] MFA Rules not processed for user `3e1b8c68b2f0435ebe3672af04353bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:28:44.297493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:44.364250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1445/2867] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:28:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:28:44.375907 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:44.377670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:28:44.435679 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718cf14-1456-40b0-abfa-cff3582bbb92 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:44.439338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:44.439980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.440268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.440588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.450044 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:44.451505 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:44.460945 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1423/2868] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:44.613110 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:28:44.623298 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea7d14-fb61-4bad-a903-ccaccecefb0f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:28:44.633490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0235-ba6d-484f-9aee-7dcdcccc4ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:28:44.633490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0235-ba6d-484f-9aee-7dcdcccc4ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:28:44.633490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0235-ba6d-484f-9aee-7dcdcccc4ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:28:44.633490 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0235-ba6d-484f-9aee-7dcdcccc4ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:28:44.676915 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:44.686145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d0235-ba6d-484f-9aee-7dcdcccc4ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:28:44.687617 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d0235-ba6d-484f-9aee-7dcdcccc4ac9 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:28:44.696889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1446/2869] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:28:44 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:28:54.456708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:28:54.966454 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:02.591476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:02.652196 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ab211-8815-47c9-9030-93c4a3b7d9ea service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:02.656658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:02.657518 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:02.657796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:02.658072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] PATH_INFO: `/v3/users/4cc443b4d9344ea49da0cc112e3ecbc4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:02.659268 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc443b4d9344ea49da0cc112e3ecbc4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:02.661200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:02.870177 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc443b4d9344ea49da0cc112e3ecbc4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:02.948960 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc443b4d9344ea49da0cc112e3ecbc4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:02.949570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc443b4d9344ea49da0cc112e3ecbc4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:02.961550 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc443b4d9344ea49da0cc112e3ecbc4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:02.968814 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc443b4d9344ea49da0cc112e3ecbc4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:02.974668 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1424/2870] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:02 2022] DELETE /identity/v3/users/4cc443b4d9344ea49da0cc112e3ecbc4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:02.979023 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:02.981771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:02.981771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:02.997234 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:02.998420 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:03.055320 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1447/2871] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:03.065367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:03.066781 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:03.123429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3727170-ffd9-49eb-8914-fef07e37f2b0 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:03.127087 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:03.127762 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:03.128045 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:03.128323 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:03.138111 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:03.139607 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:03.149068 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1425/2872] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:03.559859 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:03.560027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:03.573610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0543dc-608d-4faa-b29f-d1f65b5d4561 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:03.578607 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:03.579545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:03.579980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:03.580265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] PATH_INFO: `/v3/projects/6d17c17a8aca4fb099f0ef563bd37fa5` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:03.581869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d17c17a8aca4fb099f0ef563bd37fa5)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:03.583850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:03.692130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d17c17a8aca4fb099f0ef563bd37fa5', 'request_id': 'req-bec06156-8089-4ede-92f0-b64509b9fbbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:03.760856 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d17c17a8aca4fb099f0ef563bd37fa5', 'request_id': 'req-bec06156-8089-4ede-92f0-b64509b9fbbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:03.767895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d17c17a8aca4fb099f0ef563bd37fa5', 'request_id': 'req-bec06156-8089-4ede-92f0-b64509b9fbbf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:03.778734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] The token cache is being invalidate because project 6d17c17a8aca4fb099f0ef563bd37fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:03.779020 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:03.779670 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:03.781218 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1448/2873] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:03 2022] DELETE /identity/v3/projects/6d17c17a8aca4fb099f0ef563bd37fa5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:03.785191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:03.795018 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b992-e9d5-4909-8e18-89c004290c7a service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:03.813712 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:03.852040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:03.852913 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:03.853262 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:03.853557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] PATH_INFO: `/v3/users/3e1b8c68b2f0435ebe3672af04353bb3` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:03.854740 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1b8c68b2f0435ebe3672af04353bb3)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:03.856719 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:04.013395 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1b8c68b2f0435ebe3672af04353bb3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.069169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1b8c68b2f0435ebe3672af04353bb3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.069751 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1b8c68b2f0435ebe3672af04353bb3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.081698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1b8c68b2f0435ebe3672af04353bb3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.088940 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-0d4b259f-2a5e-431b-851e-16ee5c746cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1b8c68b2f0435ebe3672af04353bb3'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.094832 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1426/2874] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:03 2022] DELETE /identity/v3/users/3e1b8c68b2f0435ebe3672af04353bb3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:04.516095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:04.517515 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:04.536393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06156-8089-4ede-92f0-b64509b9fbbf admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:04.594376 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:04.595267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:04.595551 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:04.595829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] PATH_INFO: `/v3/projects/cd68ea9c7eae4290af2d9d76c8ccc0f7` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:04.597003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd68ea9c7eae4290af2d9d76c8ccc0f7)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:04.598925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:04.622680 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:04.708766 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd68ea9c7eae4290af2d9d76c8ccc0f7', 'request_id': 'req-f6067535-9b1c-45fd-b022-5351e3927c51'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.806824 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd68ea9c7eae4290af2d9d76c8ccc0f7', 'request_id': 'req-f6067535-9b1c-45fd-b022-5351e3927c51'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.814499 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd68ea9c7eae4290af2d9d76c8ccc0f7', 'request_id': 'req-f6067535-9b1c-45fd-b022-5351e3927c51'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.825534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] The token cache is being invalidate because project cd68ea9c7eae4290af2d9d76c8ccc0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:04.825820 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.826438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-f6067535-9b1c-45fd-b022-5351e3927c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:04.828132 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1449/2875] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:04 2022] DELETE /identity/v3/projects/cd68ea9c7eae4290af2d9d76c8ccc0f7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:04.832937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:04.833423 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:04.833523 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:04.851301 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:04.852494 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:04.910429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1427/2876] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:04.919847 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:04.920142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:04.920425 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:04.939239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:04.940447 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:04.948292 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1450/2877] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:04.952325 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:04.962200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d1389-9831-404a-a0a7-88811a3aa231 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:04.966828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:04.967524 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:04.967811 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:04.968091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:04.968826 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:29:04.969137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:04.970732 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:04.982691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1428/2878] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:29:04.986697 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:04.996427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4eecfd-2f45-47fe-bfd6-7ec971d7d94f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:05.001003 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:05.001639 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.001924 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.002205 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.002893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:05.004837 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:05.168043 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1451/2879] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:04 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:05.172051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:05.182612 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0104e-3bd0-4792-9f0f-2a0eefd857d2 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:05.208017 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:05.239296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:05.242563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.242563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.242563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.242563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:05.243360 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:05.330935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1429/2880] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:05 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:05.334836 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:05.345542 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb750f-0513-42d5-a44e-e1fa34dc85be admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:05.350265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:05.350927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.351253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.351532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.352265 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:05.353923 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:05.364281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1452/2881] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:05.368223 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:05.378578 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206802-dad8-4975-9b3e-8448be5d2ad7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:05.383035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae6574-7151-460e-887f-2df425066b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:05.383715 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae6574-7151-460e-887f-2df425066b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.384003 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae6574-7151-460e-887f-2df425066b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.384291 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae6574-7151-460e-887f-2df425066b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.385676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae6574-7151-460e-887f-2df425066b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:05.387306 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae6574-7151-460e-887f-2df425066b9b admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:05.397638 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1430/2882] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:05.401746 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:05.411753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5d942-037b-461b-96c9-e7669f37fa8b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:05.416740 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:05.417610 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.417898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.418228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] PATH_INFO: `/v3/projects/b76937c301cb458d99a92369a8a17581/users/dbbd025880664f5fa0e4ddfc922dd7cf/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.433327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76937c301cb458d99a92369a8a17581, user_id=dbbd025880664f5fa0e4ddfc922dd7cf, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:05.436142 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:05.514554 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1453/2883] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:05 2022] PUT /identity/v3/projects/b76937c301cb458d99a92369a8a17581/users/dbbd025880664f5fa0e4ddfc922dd7cf/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:05.519874 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5195ce-c5f3-413b-aca3-4b8b03611817 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.520170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5195ce-c5f3-413b-aca3-4b8b03611817 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.520455 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5195ce-c5f3-413b-aca3-4b8b03611817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.538059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-aa5195ce-c5f3-413b-aca3-4b8b03611817 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:05.539570 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-aa5195ce-c5f3-413b-aca3-4b8b03611817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:05.598278 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1431/2884] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:29:05.607850 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:05.609549 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:05.682418 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71570e75-5a5e-4cd5-a8e7-5a8ef3490a44 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:05.686006 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:05.686652 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:05.686940 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:05.687253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:05.696196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:05.698174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:05.707555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1454/2885] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:06.857873 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:06.858394 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:06.858492 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:06.889988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] MFA Rules not processed for user `dbbd025880664f5fa0e4ddfc922dd7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:06.891282 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:06.955999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1432/2886] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:06.960966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:06.970552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0900-3a12-4cb9-874d-51e83beef3ba service neutron] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:06.974988 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:06.975669 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:06.975950 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:06.976227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:06.976920 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:06.978845 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:07.059390 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1455/2887] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:06 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:29:07.063595 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:07.074659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5bf6a-bd6e-4eab-a264-8d39c03959c3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:07.106065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:07.128030 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:07.128691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:07.128973 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:07.129247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:07.129976 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:07.132390 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:07.204999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1433/2888] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:07 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:07.212163 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:07.223893 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534eae0-4fa0-4973-8de4-fb9d436134ae admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:07.228706 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:07.229366 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:07.229648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:07.229925 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:07.230878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:07.232540 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:07.238494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:07.243734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1456/2889] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:07.254782 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:07.265329 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874167a-52c9-4518-b18e-606868c92067 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:07.269919 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:07.270789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:07.271072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:07.271372 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] PATH_INFO: `/v3/projects/a81d838edcac445d8885781bc6fc80f8/users/e278137c9d164486ba40600bc2625e8b/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:07.286202 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81d838edcac445d8885781bc6fc80f8, user_id=e278137c9d164486ba40600bc2625e8b, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:07.291818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:07.407051 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1434/2890] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:07 2022] PUT /identity/v3/projects/a81d838edcac445d8885781bc6fc80f8/users/e278137c9d164486ba40600bc2625e8b/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:07.411046 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:07.421113 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c0642-aa65-44a3-9ed4-b64e9712e6c6 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:07.476520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2429ba-0cf7-44e0-85f1-7da836cc1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:07.477186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2429ba-0cf7-44e0-85f1-7da836cc1417 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:07.477473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2429ba-0cf7-44e0-85f1-7da836cc1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:07.477753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2429ba-0cf7-44e0-85f1-7da836cc1417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:07.478544 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2429ba-0cf7-44e0-85f1-7da836cc1417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:07.480128 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2429ba-0cf7-44e0-85f1-7da836cc1417 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:07.490198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1457/2891] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:07.494831 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:07.504985 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829cd4a-4062-44e9-b6cf-bbc28a69dd2a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:07.510108 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:07.510980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:07.511292 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:07.511572 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] PATH_INFO: `/v3/projects/a81d838edcac445d8885781bc6fc80f8/users/e278137c9d164486ba40600bc2625e8b/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:07.513536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81d838edcac445d8885781bc6fc80f8, user_id=e278137c9d164486ba40600bc2625e8b, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:07.516194 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:07.526089 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1435/2892] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:07 2022] PUT /identity/v3/projects/a81d838edcac445d8885781bc6fc80f8/users/e278137c9d164486ba40600bc2625e8b/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:08.657523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:08.657523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:08.657523 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:08.682665 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] MFA Rules not processed for user `e278137c9d164486ba40600bc2625e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:08.683901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:08.752823 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1458/2893] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:08.764737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:08.766671 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:08.832868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e19e-2e4f-4527-98ac-da2811e5a175 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:08.836466 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:08.837107 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:08.837900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:08.838209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:08.892225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:08.893589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:08.902851 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1436/2894] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:10.575889 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:10.577333 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:10.589327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159313c9-22ae-4b89-8501-d38247ada690 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:10.592855 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:10.593495 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:10.593779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:10.594052 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:10.602908 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:10.604975 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:10.614146 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1459/2895] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:18.898409 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:20.610074 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=69 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:25.417127 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:25.418711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:25.491867 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275ec51-6f76-4422-97fd-8b9ff6a10bfc service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:25.497346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:25.497999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:25.498286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:25.498566 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:25.500377 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:25.520822 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:25.522346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:25.539231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1437/2896] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:26.182687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:26.245590 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042f29-83d2-404d-8a1f-7d8d7cf705db service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:26.250781 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:26.251677 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:26.251970 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:26.252250 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] PATH_INFO: `/v3/users/dbbd025880664f5fa0e4ddfc922dd7cf` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:26.253427 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbbd025880664f5fa0e4ddfc922dd7cf)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:26.255386 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:26.413998 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbbd025880664f5fa0e4ddfc922dd7cf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.414586 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbbd025880664f5fa0e4ddfc922dd7cf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.415222 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbbd025880664f5fa0e4ddfc922dd7cf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.426895 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbbd025880664f5fa0e4ddfc922dd7cf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.433787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbbd025880664f5fa0e4ddfc922dd7cf'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.496790 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1460/2897] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:26 2022] DELETE /identity/v3/users/dbbd025880664f5fa0e4ddfc922dd7cf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:26.768387 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:26.778937 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42942b5-3700-47e4-9ce4-b519fc1a0774 service placement] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:26.837300 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:26.838158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:26.838439 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:26.838760 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] PATH_INFO: `/v3/projects/b76937c301cb458d99a92369a8a17581` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:26.840211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76937c301cb458d99a92369a8a17581)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:26.842174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:26.942853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76937c301cb458d99a92369a8a17581', 'request_id': 'req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.948281 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76937c301cb458d99a92369a8a17581', 'request_id': 'req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:26.954185 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76937c301cb458d99a92369a8a17581', 'request_id': 'req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.017061 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] The token cache is being invalidate because project b76937c301cb458d99a92369a8a17581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:27.017258 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.017868 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.019427 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1438/2898] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:26 2022] DELETE /identity/v3/projects/b76937c301cb458d99a92369a8a17581 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:27.023532 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:27.024927 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:27.037954 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeeefe-bc92-4743-86ff-d43083a671c2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:27.093282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:27.094145 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:27.094426 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:27.094700 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] PATH_INFO: `/v3/users/e278137c9d164486ba40600bc2625e8b` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:27.095899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e278137c9d164486ba40600bc2625e8b)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:27.097829 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:27.119926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:27.271779 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e278137c9d164486ba40600bc2625e8b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.272408 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e278137c9d164486ba40600bc2625e8b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.272956 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e278137c9d164486ba40600bc2625e8b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.285133 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e278137c9d164486ba40600bc2625e8b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.292238 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-be5d80fd-ea89-4e4e-94e1-607d28216923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e278137c9d164486ba40600bc2625e8b'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.354437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1461/2899] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:27 2022] DELETE /identity/v3/users/e278137c9d164486ba40600bc2625e8b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:29:27.573317 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:27.574739 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:27.587339 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f9dd1-acb9-4db1-9f71-b6a2504f036c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:27.607711 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:27.647021 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:27.647915 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:27.648200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:27.648479 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] PATH_INFO: `/v3/projects/a81d838edcac445d8885781bc6fc80f8` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:27.649704 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81d838edcac445d8885781bc6fc80f8)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:27.651718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:27.795126 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81d838edcac445d8885781bc6fc80f8', 'request_id': 'req-177d038a-032c-425d-a22d-19961b903c37'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.800884 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81d838edcac445d8885781bc6fc80f8', 'request_id': 'req-177d038a-032c-425d-a22d-19961b903c37'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.808473 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81d838edcac445d8885781bc6fc80f8', 'request_id': 'req-177d038a-032c-425d-a22d-19961b903c37'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.884316 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] The token cache is being invalidate because project a81d838edcac445d8885781bc6fc80f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:27.884537 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.885174 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-177d038a-032c-425d-a22d-19961b903c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:27.886761 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1439/2900] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:27 2022] DELETE /identity/v3/projects/a81d838edcac445d8885781bc6fc80f8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:27.892175 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:27.892473 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:27.892756 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:27.910812 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:27.912048 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:27.969630 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1462/2901] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:27.977028 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:27.977321 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:27.977628 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:27.995314 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:27.996506 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:28.004274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1440/2902] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:28.008328 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.018197 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8575f-e785-4487-a688-9f0af8c4272f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.022646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.023309 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.023594 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.023869 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.024583 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:29:28.024887 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.026464 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.039071 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1463/2903] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:29:28.045062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.054167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccc3b1-0c99-4089-8400-71917ccfb05f None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.058714 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.059457 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.059737 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.060011 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.061303 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.063203 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.156472 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1441/2904] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:28 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:29:28.160675 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.171231 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0c926-e707-4215-abb6-fabbe2ea83ea admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.226775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.227480 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.227770 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.228051 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.228753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.230765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.337860 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1464/2905] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:28 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:28.341900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.352405 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703a67c-18ac-411a-8e23-e47221403799 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.357001 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.357651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.357933 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.358208 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.358935 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.360626 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.380389 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1442/2906] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:28.384537 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.396711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247616f-898f-4fe9-85bf-aaf323a2f341 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.403885 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321077-f6a1-4135-bb4d-08ab93824b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.404557 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321077-f6a1-4135-bb4d-08ab93824b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.404842 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321077-f6a1-4135-bb4d-08ab93824b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.405121 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321077-f6a1-4135-bb4d-08ab93824b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.405851 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9321077-f6a1-4135-bb4d-08ab93824b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.409456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9321077-f6a1-4135-bb4d-08ab93824b11 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.420278 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1465/2907] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:28.424474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.434211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf456-303d-4c2c-9f1d-d563f41c801e admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.439240 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.440140 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.440419 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.440691 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] PATH_INFO: `/v3/projects/d4fe9aa3bc8040548435ca2f8217af2a/users/4ed680ed200043c889a0a10d0b4b58b4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.454905 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fe9aa3bc8040548435ca2f8217af2a, user_id=4ed680ed200043c889a0a10d0b4b58b4, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.457568 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.508496 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1443/2908] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:28 2022] PUT /identity/v3/projects/d4fe9aa3bc8040548435ca2f8217af2a/users/4ed680ed200043c889a0a10d0b4b58b4/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:28.524771 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.525067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.525350 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.532017 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:28.552439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] MFA Rules not processed for user `4ed680ed200043c889a0a10d0b4b58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:28.553647 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:28.617198 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1466/2909] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:28.621995 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.673015 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:28.686587 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e7d7-eb40-4be5-9042-3f25f3b0a8fe admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.693253 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.693942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.694211 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.694516 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.695283 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.697206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.784815 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1444/2910] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:28 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:28.789035 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.800407 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe1c0-7a90-4523-a618-72241c7410bd None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.856085 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.856699 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.856982 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.857282 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] PATH_INFO: `/v3/users` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.857969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.859917 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.958876 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1467/2911] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:28 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:28.962773 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:28.973083 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903d94e-83ae-43a5-8103-0d3dce2806d1 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:28.978119 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:28.978777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:28.979063 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:28.979381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:28.980112 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:28.981796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:28.992131 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1445/2912] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:28.995984 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:29.006269 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3c52-ae7c-49c5-8159-9deaf43bb219 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:29.010815 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:29.011715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:29.011997 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:29.012271 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] PATH_INFO: `/v3/projects/36bf10302cc742acaaca4d303371e793/users/53938258f8634ef3a40dd371532689ee/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:29.027225 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bf10302cc742acaaca4d303371e793, user_id=53938258f8634ef3a40dd371532689ee, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:29.029901 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:29.102676 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1468/2913] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:28 2022] PUT /identity/v3/projects/36bf10302cc742acaaca4d303371e793/users/53938258f8634ef3a40dd371532689ee/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:29:29.106748 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:29.116606 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7b0fa-3ef1-40c5-b937-64db82a5544c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:29.172285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f0299-749a-4d37-9d87-59f0ebd6a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:29.172956 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f0299-749a-4d37-9d87-59f0ebd6a449 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:29.173248 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f0299-749a-4d37-9d87-59f0ebd6a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:29.173530 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f0299-749a-4d37-9d87-59f0ebd6a449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:29.174264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f0299-749a-4d37-9d87-59f0ebd6a449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:29.175931 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f0299-749a-4d37-9d87-59f0ebd6a449 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:29.186247 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1446/2914] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:29.190284 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:29.200494 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b603-5b52-43d9-b018-138bfa50e7d4 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:29.205124 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:29.205996 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:29.206281 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:29.206566 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] PATH_INFO: `/v3/projects/36bf10302cc742acaaca4d303371e793/users/53938258f8634ef3a40dd371532689ee/roles/cc12091eec434ea294a879c1b207931e` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:29.208601 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bf10302cc742acaaca4d303371e793, user_id=53938258f8634ef3a40dd371532689ee, role_id=cc12091eec434ea294a879c1b207931e)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:29.211335 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:29.221204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1469/2915] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:29 2022] PUT /identity/v3/projects/36bf10302cc742acaaca4d303371e793/users/53938258f8634ef3a40dd371532689ee/roles/cc12091eec434ea294a879c1b207931e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:29.232721 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:29.233036 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:29.233315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:29.259406 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] MFA Rules not processed for user `53938258f8634ef3a40dd371532689ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:29.260588 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:29.327338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1447/2916] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:29.337750 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:29.339534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:29.390393 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:29.395505 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23bf09-7122-4b7b-82f9-cbcd13ffd5a9 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:29.399053 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:29.399711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:29.399994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:29.400268 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:29.455183 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:29.456646 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:29.465439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1470/2917] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:34.496651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:34.498729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:34.510672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42b967-0ead-4593-8441-b4a1b7b94d69 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:34.514898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:34.515532 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:34.515818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:34.519234 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:34.526191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:34.527694 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:34.537991 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1448/2918] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:35.221396 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:35.222788 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:35.307067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588dc8-887f-46ee-b48d-08f1366bffd5 service cinder] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:35.313329 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:35.313994 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:35.314267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:35.314545 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:35.316332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:35.328187 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:35.329801 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25ea28-12c8-4307-afbe-02206b835e8e service placement] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:35.339626 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1471/2919] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:40.330698 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:40.360269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:40.392206 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd093d8-20b9-4992-a28c-ae08a48dc47a service cinder] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:40.397091 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:40.397962 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:40.398245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:40.398520 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] PATH_INFO: `/v3/users/4ed680ed200043c889a0a10d0b4b58b4` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:40.399722 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed680ed200043c889a0a10d0b4b58b4)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:40.401633 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:40.572245 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed680ed200043c889a0a10d0b4b58b4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:40.656133 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed680ed200043c889a0a10d0b4b58b4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:40.656755 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed680ed200043c889a0a10d0b4b58b4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:40.669084 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed680ed200043c889a0a10d0b4b58b4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:40.676340 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed680ed200043c889a0a10d0b4b58b4'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:40.682269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1449/2920] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:40 2022] DELETE /identity/v3/users/4ed680ed200043c889a0a10d0b4b58b4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:40.687439 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:40.687930 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:40.688021 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:40.705332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:40.706527 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:40.763641 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1472/2921] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:40.773592 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:40.774999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:40.832614 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa89238-b509-40e1-9bc1-dd062060d407 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:40.836124 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:40.836763 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:40.837042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:40.837315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:40.846429 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:40.848059 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:40.858012 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1450/2922] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:41.257902 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:41.259745 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:41.272083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1f543-c94e-4f83-b983-0fa955013262 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:41.278331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:41.279421 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:41.279552 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:41.279881 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] PATH_INFO: `/v3/projects/d4fe9aa3bc8040548435ca2f8217af2a` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:41.282251 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fe9aa3bc8040548435ca2f8217af2a)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:41.284487 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:41.303896 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=100 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:41.400349 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fe9aa3bc8040548435ca2f8217af2a', 'request_id': 'req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.479807 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fe9aa3bc8040548435ca2f8217af2a', 'request_id': 'req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.486106 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fe9aa3bc8040548435ca2f8217af2a', 'request_id': 'req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.496489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] The token cache is being invalidate because project d4fe9aa3bc8040548435ca2f8217af2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:41.496772 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.497384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.498898 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1473/2923] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:41 2022] DELETE /identity/v3/projects/d4fe9aa3bc8040548435ca2f8217af2a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:41.502941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:41.512699 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d9d3-cce5-408a-ae14-94cf6503cb1d service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:41.561703 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:41.571338 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:41.572212 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:41.572495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:41.572772 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] PATH_INFO: `/v3/users/53938258f8634ef3a40dd371532689ee` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:41.573942 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=53938258f8634ef3a40dd371532689ee)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:41.576024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:41.784315 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53938258f8634ef3a40dd371532689ee'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.862886 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53938258f8634ef3a40dd371532689ee'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.863600 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53938258f8634ef3a40dd371532689ee'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.879367 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53938258f8634ef3a40dd371532689ee'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.888351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-59e597f1-c460-4990-be14-f436080c19aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53938258f8634ef3a40dd371532689ee'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:41.895040 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1451/2924] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:41 2022] DELETE /identity/v3/users/53938258f8634ef3a40dd371532689ee => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:42.312227 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:42.312761 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:42.329585 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0300d-cdd6-44fa-a473-b94df7ab8f46 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:42.387079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:42.387966 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:42.388248 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:42.392559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] PATH_INFO: `/v3/projects/36bf10302cc742acaaca4d303371e793` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:42.392559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bf10302cc742acaaca4d303371e793)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:42.392559 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:42.524995 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bf10302cc742acaaca4d303371e793', 'request_id': 'req-68535073-9496-490a-96a6-1894eb3ae2ef'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:42.605773 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bf10302cc742acaaca4d303371e793', 'request_id': 'req-68535073-9496-490a-96a6-1894eb3ae2ef'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:42.612067 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bf10302cc742acaaca4d303371e793', 'request_id': 'req-68535073-9496-490a-96a6-1894eb3ae2ef'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:42.622381 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] The token cache is being invalidate because project 36bf10302cc742acaaca4d303371e793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:42.622663 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:42.623314 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-68535073-9496-490a-96a6-1894eb3ae2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:42.625331 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1474/2925] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:42 2022] DELETE /identity/v3/projects/36bf10302cc742acaaca4d303371e793 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:42.631318 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:42.631796 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:42.631917 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:42.650450 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:42.651689 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:42.710743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1452/2926] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:42.719619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:42.719916 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:42.720195 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:42.738063 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:42.739287 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:42.747450 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1475/2927] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:42.751474 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:42.761024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b2fc5-de48-4861-a8f8-7b38dfa32d35 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:42.766058 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:42.770169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:42.770169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:42.770169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:42.770169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:29:42.770169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:42.770169 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:42.782789 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1453/2928] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:29:42.786926 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:42.796384 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912860e-f870-48dc-ae88-e10551c8820e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:42.800980 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:42.801622 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:42.801907 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:42.802186 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:42.802878 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:42.804861 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:42.887718 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1476/2929] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:42 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:42.892285 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:42.902264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d73d-4c03-4280-aaf8-9b140c303c74 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:42.952073 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:42.958307 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:42.958955 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:42.959270 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:42.959639 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:42.960242 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:42.962137 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:43.046683 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1454/2930] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:42 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:43.050181 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:43.060267 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061fc02-5c1f-40d7-a9cb-7ef90524365b admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:43.065299 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:43.065944 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:43.068774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:43.068774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:43.068774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:43.069029 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:43.070012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:43.080279 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1477/2931] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:43.084037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:43.094144 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fcd6d-4559-401b-b864-06e4f3d22df2 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:43.098678 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4e46e-c6bf-4c60-87c5-608c65ab718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:43.099366 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4e46e-c6bf-4c60-87c5-608c65ab718f admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:43.099652 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4e46e-c6bf-4c60-87c5-608c65ab718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:43.099930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4e46e-c6bf-4c60-87c5-608c65ab718f admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:43.100718 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4e46e-c6bf-4c60-87c5-608c65ab718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:43.102286 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4e46e-c6bf-4c60-87c5-608c65ab718f admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:43.112064 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1455/2932] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:43.115973 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:43.126079 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a057be-50f0-46e2-8146-60601a6a7218 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:43.130813 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:43.132034 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:43.132485 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:43.133135 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] PATH_INFO: `/v3/projects/e0a4c13686a0499eb17364e6c9b949ca/users/7d41299e8dab46b19ed33f0660dfcd4a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:43.147661 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a4c13686a0499eb17364e6c9b949ca, user_id=7d41299e8dab46b19ed33f0660dfcd4a, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:43.150246 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:43.252260 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1478/2933] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:43 2022] PUT /identity/v3/projects/e0a4c13686a0499eb17364e6c9b949ca/users/7d41299e8dab46b19ed33f0660dfcd4a/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:43.264509 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:43.264813 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:43.265793 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:43.291627 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] MFA Rules not processed for user `7d41299e8dab46b19ed33f0660dfcd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:43.292900 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:43.369167 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1456/2934] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:43.380576 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:43.382334 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:43.439065 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f9a4d-c869-48d0-bd73-2d0938ea7043 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:43.442664 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464109-8ed2-4295-91fd-503847ee4ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:43.443332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464109-8ed2-4295-91fd-503847ee4ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:43.443615 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464109-8ed2-4295-91fd-503847ee4ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:43.443892 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464109-8ed2-4295-91fd-503847ee4ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:43.452157 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77464109-8ed2-4295-91fd-503847ee4ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:43.453666 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77464109-8ed2-4295-91fd-503847ee4ed4 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:43.462391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1479/2935] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:53.360319 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=40,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:53.458405 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:55.363275 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:55.425613 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46c7c0-7657-4cd1-9529-737910cf13cc None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:55.430170 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:55.431034 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:55.431351 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:55.431636 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] PATH_INFO: `/v3/users/7d41299e8dab46b19ed33f0660dfcd4a` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:55.432828 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d41299e8dab46b19ed33f0660dfcd4a)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:55.434743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:55.631653 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d41299e8dab46b19ed33f0660dfcd4a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:55.703449 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d41299e8dab46b19ed33f0660dfcd4a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:55.704060 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d41299e8dab46b19ed33f0660dfcd4a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:55.716415 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d41299e8dab46b19ed33f0660dfcd4a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:55.726299 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d41299e8dab46b19ed33f0660dfcd4a'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:55.732190 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1457/2936] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:55 2022] DELETE /identity/v3/users/7d41299e8dab46b19ed33f0660dfcd4a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:55.736735 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:55.737196 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:55.737529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:55.754536 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:55.755753 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:55.814173 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1480/2937] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:29:55.825708 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:55.827188 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:55.883680 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea94e9-5c22-4247-87b9-88009fe11f45 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:55.887274 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1de027-768b-4a77-82be-db3e0bc76d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:55.887914 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1de027-768b-4a77-82be-db3e0bc76d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:55.888200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1de027-768b-4a77-82be-db3e0bc76d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:55.888478 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1de027-768b-4a77-82be-db3e0bc76d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:55.898209 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1de027-768b-4a77-82be-db3e0bc76d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:55.899676 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1de027-768b-4a77-82be-db3e0bc76d3b service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:55.909271 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1458/2938] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:56.367711 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:56.369294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:56.382469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae4193-fa76-409b-9db5-8c82afd97884 None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:56.387149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:56.387969 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:56.388247 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:56.388535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] PATH_INFO: `/v3/projects/e0a4c13686a0499eb17364e6c9b949ca` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:56.390348 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a4c13686a0499eb17364e6c9b949ca)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:56.392346 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:56.503192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a4c13686a0499eb17364e6c9b949ca', 'request_id': 'req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:56.581459 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a4c13686a0499eb17364e6c9b949ca', 'request_id': 'req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:56.587882 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a4c13686a0499eb17364e6c9b949ca', 'request_id': 'req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:56.598149 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] The token cache is being invalidate because project e0a4c13686a0499eb17364e6c9b949ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:56.598438 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:56.599068 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-4ca41008-086b-44bf-a5e4-619e2aaf9d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:56.600638 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1481/2939] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:56 2022] DELETE /identity/v3/projects/e0a4c13686a0499eb17364e6c9b949ca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:56.605463 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:56.605930 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:56.606024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:56.623904 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:56.625659 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:56.642862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:56.684042 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1459/2940] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:56.692235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:56.692534 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:56.692821 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:56.711611 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:56.712814 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:56.720613 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1482/2941] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:56.724623 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:56.733999 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e73c9-3729-4b98-8338-46bcc7a0bf9e None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:56.738862 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:56.739545 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:56.739898 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:56.740173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:56.740903 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:29:56.741207 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:56.742799 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:56.755230 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1460/2942] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:29:56.759688 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:56.770109 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7b54f-881f-49e5-b2c5-c5bc26e09e4d None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:56.774715 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:56.775402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:56.775692 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:56.775968 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:56.776687 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:56.778599 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:56.875614 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1483/2943] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:56 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:29:56.879787 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:56.890417 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bda19-133e-491f-a217-e18e07c67cb9 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:56.945906 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:56.946495 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:56.946777 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:56.947053 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:56.947770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:56.949672 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.021997 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1461/2944] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:56 2022] POST /identity/v3/users => generated 280 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:57.026130 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:57.037069 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87993-fc4b-484e-9cb5-4da311c3d7cb admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:57.041935 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:57.042589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.042872 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.043174 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.043899 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:57.045489 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.055708 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1484/2945] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:57.059500 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:57.069521 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6112d6-cc79-424c-a4cd-a077eec6967c admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:57.074080 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8674c2a-ac1b-47b2-9e0e-8ed38932b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:57.074729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674c2a-ac1b-47b2-9e0e-8ed38932b322 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.075013 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674c2a-ac1b-47b2-9e0e-8ed38932b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.075324 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674c2a-ac1b-47b2-9e0e-8ed38932b322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.076047 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8674c2a-ac1b-47b2-9e0e-8ed38932b322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:57.078148 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8674c2a-ac1b-47b2-9e0e-8ed38932b322 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.087980 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1462/2946] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:57.091863 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:57.102170 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ebd4-9335-47bf-ba11-62597569d266 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:57.107040 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:57.107963 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.108252 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.108529 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] PATH_INFO: `/v3/projects/0e2c2fd280e643f5a72fa2d255855dc2/users/823e9cc5f2014b6c9665246f2b95f154/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.122775 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2c2fd280e643f5a72fa2d255855dc2, user_id=823e9cc5f2014b6c9665246f2b95f154, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:57.125469 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.192831 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1485/2947] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:57 2022] PUT /identity/v3/projects/0e2c2fd280e643f5a72fa2d255855dc2/users/823e9cc5f2014b6c9665246f2b95f154/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:29:57.203420 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.203651 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.203928 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.231173 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] MFA Rules not processed for user `823e9cc5f2014b6c9665246f2b95f154`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:57.232381 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:57.296353 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1463/2948] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:57.326028 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:57.328402 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:57.350204 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:57.386382 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775d9f9-f8ec-4b01-b594-4c1fdd24f813 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:57.390734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628c8b5-7866-4709-9b1a-847fe8f38614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:57.391467 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628c8b5-7866-4709-9b1a-847fe8f38614 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.391751 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628c8b5-7866-4709-9b1a-847fe8f38614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.392055 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628c8b5-7866-4709-9b1a-847fe8f38614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.401493 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628c8b5-7866-4709-9b1a-847fe8f38614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:57.403129 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628c8b5-7866-4709-9b1a-847fe8f38614 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.413516 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1486/2949] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:57 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:29:57.428655 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:57.449576 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:57.496849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1cbb-1499-4f90-b41b-e8b5265f2533 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:57.501665 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:57.502567 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.502853 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.503157 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] PATH_INFO: `/v3/users/823e9cc5f2014b6c9665246f2b95f154` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.504413 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=823e9cc5f2014b6c9665246f2b95f154)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:57.506379 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.687072 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823e9cc5f2014b6c9665246f2b95f154'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:57.766032 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823e9cc5f2014b6c9665246f2b95f154'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:57.766601 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823e9cc5f2014b6c9665246f2b95f154'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:57.778686 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823e9cc5f2014b6c9665246f2b95f154'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:57.785476 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823e9cc5f2014b6c9665246f2b95f154'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:57.791536 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1464/2950] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:29:57 2022] DELETE /identity/v3/users/823e9cc5f2014b6c9665246f2b95f154 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:57.798325 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.798952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.798952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.816440 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:57.817618 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:57.876605 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1487/2951] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:57.886158 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:57.887571 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:57.945346 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81444f5-6398-4714-9b49-dae9d7185cb1 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:57.949818 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aba83b-0a26-45dd-b327-71d2f8205f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:57.950465 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aba83b-0a26-45dd-b327-71d2f8205f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:57.950747 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aba83b-0a26-45dd-b327-71d2f8205f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:57.951023 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aba83b-0a26-45dd-b327-71d2f8205f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:57.969770 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aba83b-0a26-45dd-b327-71d2f8205f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:57.971540 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aba83b-0a26-45dd-b327-71d2f8205f4b service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:57.981006 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1465/2952] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:29:58.384648 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:58.386212 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:58.399239 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111be66-2ab2-4d11-9848-ac35e4bfb32c None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:58.456518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:58.456518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:58.456518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:58.456518 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] PATH_INFO: `/v3/projects/0e2c2fd280e643f5a72fa2d255855dc2` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:58.457879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2c2fd280e643f5a72fa2d255855dc2)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:58.457879 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:58.652274 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2c2fd280e643f5a72fa2d255855dc2', 'request_id': 'req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:58.707083 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2c2fd280e643f5a72fa2d255855dc2', 'request_id': 'req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:58.713476 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2c2fd280e643f5a72fa2d255855dc2', 'request_id': 'req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:58.724087 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] The token cache is being invalidate because project 0e2c2fd280e643f5a72fa2d255855dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:29:58.724369 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:58.725015 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-01cc6067-60b4-44cc-8c6b-e6f6f033f88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:29:58.726535 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1488/2953] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:29:58 2022] DELETE /identity/v3/projects/0e2c2fd280e643f5a72fa2d255855dc2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:58.731471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:58.733743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:58.733743 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:58.750424 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:58.751658 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:58.784363 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:58.809024 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1466/2954] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:58.818143 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:58.819774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:58.819774 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:58.838091 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:58.839358 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:58.847256 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1489/2955] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:58.851565 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:58.861596 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfbe86-6b0c-4877-8a1a-f282adf9e640 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:58.866296 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:58.867231 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:58.867701 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:58.868345 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] PATH_INFO: `/v3/domains` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:58.869130 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:29:58.869444 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:58.871035 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:58.882926 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1467/2956] 10.222.0.32 () {58 vars in 1152 bytes} [Mon May 23 16:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:29:58.887148 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:58.896952 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2cb80-9205-4e42-8b27-1b2b4bf1c66e None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:58.901589 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:58.902235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:58.902569 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:58.902799 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] PATH_INFO: `/v3/projects` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:58.903520 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:58.905446 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:58.988095 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1490/2957] 10.222.0.32 () {60 vars in 1152 bytes} [Mon May 23 16:29:58 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:29:58.992538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:59.003302 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf36cfd-ba40-47c7-8ae1-5ac830fb8828 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:59.057705 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:59.058380 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:59.058663 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:59.058941 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:59.059666 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:59.061558 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:59.200430 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1468/2958] 10.222.0.32 () {60 vars in 1143 bytes} [Mon May 23 16:29:58 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:29:59.204787 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:59.215012 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054bf62-70e2-4c53-be44-8e15374b279d admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:59.220112 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:59.220765 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:59.221054 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:59.221332 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:59.222099 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:59.223734 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:59.234294 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1491/2959] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:29:59.238356 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:59.248369 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12295-3f3c-415f-8559-184413ae03f7 admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:59.252969 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088213a-4d3a-4c93-aba6-18d2fe1e84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:59.253622 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088213a-4d3a-4c93-aba6-18d2fe1e84c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:59.253909 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088213a-4d3a-4c93-aba6-18d2fe1e84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:59.254191 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088213a-4d3a-4c93-aba6-18d2fe1e84c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:59.254943 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088213a-4d3a-4c93-aba6-18d2fe1e84c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:59.256563 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088213a-4d3a-4c93-aba6-18d2fe1e84c0 admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:59.267192 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1469/2960] 10.222.0.32 () {58 vars in 1121 bytes} [Mon May 23 16:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:29:59.271064 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:59.281717 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e347ac-2e5e-4b9c-a013-dcf0b10e97e2 admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:59.286221 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:59.287105 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] REQUEST_METHOD: `PUT` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:59.287411 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:59.287789 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] PATH_INFO: `/v3/projects/0a574cf3ab744f499dd5480ab8288311/users/1ba2f0c95140478bb3e733e8ef537837/roles/0f3b3ee617cb4eeb9055e6e42f163ed4` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:59.290253 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:29:59.302894 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a574cf3ab744f499dd5480ab8288311, user_id=1ba2f0c95140478bb3e733e8ef537837, role_id=0f3b3ee617cb4eeb9055e6e42f163ed4)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:59.305587 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:59.378027 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1492/2961] 10.222.0.32 () {60 vars in 1482 bytes} [Mon May 23 16:29:59 2022] PUT /identity/v3/projects/0a574cf3ab744f499dd5480ab8288311/users/1ba2f0c95140478bb3e733e8ef537837/roles/0f3b3ee617cb4eeb9055e6e42f163ed4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:29:59.388264 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] REQUEST_METHOD: `POST` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:59.388557 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:59.388854 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:59.416332 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.auth.core [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] MFA Rules not processed for user `1ba2f0c95140478bb3e733e8ef537837`. Rule list: `[]` (Enabled: `True`). {{(pid=80555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:29:59.417517 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:59.479493 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1470/2962] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:29:59.490500 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:29:59.492203 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:29:59.547637 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4a89-88a1-431a-aaa3-62f2bab8462c admin admin] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:29:59.551228 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313dd8d-9bcd-48a2-8490-6ee991c5dc92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2edb5d30e76d488491a9d7c38b3300f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:29:59.551864 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313dd8d-9bcd-48a2-8490-6ee991c5dc92 service cinder] REQUEST_METHOD: `GET` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:29:59.552151 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313dd8d-9bcd-48a2-8490-6ee991c5dc92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:29:59.552428 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313dd8d-9bcd-48a2-8490-6ee991c5dc92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:29:59.560506 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313dd8d-9bcd-48a2-8490-6ee991c5dc92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:29:59.562449 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313dd8d-9bcd-48a2-8490-6ee991c5dc92 service cinder] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:29:59.571191 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1493/2963] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:29:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:30:09.476464 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:09.525057 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:09.567192 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:09.584065 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bab4a-48b4-4654-84b4-642bb47547b3 None None] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:09.588538 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:09.589401 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:09.589681 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:09.589982 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] PATH_INFO: `/v3/users/1ba2f0c95140478bb3e733e8ef537837` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:09.591218 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba2f0c95140478bb3e733e8ef537837)` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:09.593654 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:09.786129 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba2f0c95140478bb3e733e8ef537837'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:09.867225 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba2f0c95140478bb3e733e8ef537837'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:09.867844 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba2f0c95140478bb3e733e8ef537837'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:09.880056 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba2f0c95140478bb3e733e8ef537837'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:09.887005 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.notifications [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba2f0c95140478bb3e733e8ef537837'} {{(pid=80555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:09.892849 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1471/2964] 10.222.0.32 () {58 vars in 1223 bytes} [Mon May 23 16:30:09 2022] DELETE /identity/v3/users/1ba2f0c95140478bb3e733e8ef537837 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:30:09.897327 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] REQUEST_METHOD: `POST` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:09.897625 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:09.897912 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:09.915470 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.auth.core [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] MFA Rules not processed for user `f9d0e31020494ca584e4bf621abe8d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:30:09.916672 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:09.974479 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1494/2965] 10.222.0.32 () {58 vars in 957 bytes} [Mon May 23 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:30:09.984670 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:09.986039 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:10.180608 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130886-efdf-4560-a92e-03ffda39520a admin admin] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.184062 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f5e9e3f2475457ba9b307438e5cf97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.184707 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.184988 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.185261 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.194159 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.195620 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.205471 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1472/2966] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:30:10.670436 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] Authenticating user token {{(pid=80556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:30:10.671943 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.fernet_utils [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:30:10.684391 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d822-1676-4983-b021-97243e44f60f None None] Validating token access rules against request {{(pid=80556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:30:10.689645 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d0e31020494ca584e4bf621abe8d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75147bc201bf4c1086a8eadbdc968fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:30:10.690555 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:30:10.690849 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:30:10.691200 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] PATH_INFO: `/v3/projects/0a574cf3ab744f499dd5480ab8288311` {{(pid=80556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:30:10.692456 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a574cf3ab744f499dd5480ab8288311)` {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:30:10.694619 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] RBAC: Authorization granted {{(pid=80556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:30:10.800609 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a574cf3ab744f499dd5480ab8288311', 'request_id': 'req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:10.851592 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a574cf3ab744f499dd5480ab8288311', 'request_id': 'req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:10.858235 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a574cf3ab744f499dd5480ab8288311', 'request_id': 'req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8'} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:10.869341 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] The token cache is being invalidate because project 0a574cf3ab744f499dd5480ab8288311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:30:10.869624 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:10.870242 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG keystone.notifications [None req-5c4d9d90-721f-4eec-b4ec-aa5f5b2b60f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:30:10.871865 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: [pid: 80556|app: 0|req: 1495/2967] 10.222.0.32 () {58 vars in 1232 bytes} [Mon May 23 16:30:10 2022] DELETE /identity/v3/projects/0a574cf3ab744f499dd5480ab8288311 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:30:20.200823 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:30:20.866437 dv-cinder-835881-14-iscsi devstack@keystone.service[80556]: DEBUG dbcounter [-] [80556] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:34:40.257830 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] Authenticating user token {{(pid=80555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:34:40.259239 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:34:40.347037 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c6ad-668b-4598-9b81-b39964935fc3 service neutron] Validating token access rules against request {{(pid=80555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:34:40.404066 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e4d094e08a4f1d92aed40961789f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd46ffdca084231b63751f121b988fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:34:40.404710 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] REQUEST_METHOD: `GET` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:34:40.404994 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] SCRIPT_NAME: `/identity` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:34:40.405269 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:34:40.407020 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.fernet_utils [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:34:40.418729 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:34:40.420589 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a3cba-b082-4508-b2ff-a240d2fd97ef service placement] RBAC: Authorization granted {{(pid=80555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:34:40.430232 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: [pid: 80555|app: 0|req: 1473/2968] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 23 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:34:50.426200 dv-cinder-835881-14-iscsi devstack@keystone.service[80555]: DEBUG dbcounter [-] [80555] Writing DB stats keystone:SELECT=67 {{(pid=80555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}